Jul 08 09:07:03.374781 ip-10-0-135-104 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 09:07:03.770046 ip-10-0-135-104 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 09:07:03.770046 ip-10-0-135-104 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 09:07:03.770046 ip-10-0-135-104 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 09:07:03.770046 ip-10-0-135-104 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 09:07:03.770046 ip-10-0-135-104 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 09:07:03.770957 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.770860    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 09:07:03.775612 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775592    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.775612 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775611    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775616    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775622    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775626    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775630    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775634    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775637    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775641    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775644    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775647    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775650    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775653    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775656    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775659    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775662    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775665    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775676    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775679    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775682    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775685    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.775687 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775688    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775691    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775694    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775697    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775700    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775703    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775706    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775709    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775712    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775714    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775717    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775720    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775723    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775726    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775729    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775732    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775734    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775737    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775740    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775750    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.776266 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775755    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775758    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775762    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775767    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775770    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775773    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775775    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775778    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775781    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775784    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775787    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775790    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775794    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775799    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775803    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775806    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775809    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775812    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775816    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.776784 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775818    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775821    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775824    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775827    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775830    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775833    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775836    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775840    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775843    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775846    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775849    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775854    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775856    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775859    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775862    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775865    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775867    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775870    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775873    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775875    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.777285 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775878    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775882    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775884    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775887    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775890    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775892    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775895    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775900    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775903    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775906    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775909    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775912    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775915    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775918    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775920    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775923    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775926    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775929    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.775932    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776759    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.777831 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776767    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776770    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776773    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776776    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776780    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776783    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776786    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776789    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776792    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776795    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776798    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776801    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776804    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776807    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776810    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776813    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776816    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776819    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776822    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.778333 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776826    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776829    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776832    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776835    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776838    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776841    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776844    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776847    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776849    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776852    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776855    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776858    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776861    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776864    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776867    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776869    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776872    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776874    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776878    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776881    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.778884 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776884    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776886    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776890    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776893    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776895    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776898    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776901    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776904    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776907    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776909    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776912    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776915    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776918    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776921    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776924    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776955    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776960    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776963    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776966    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776969    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.779398 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776972    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776975    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776978    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776981    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776984    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776987    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776989    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776992    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776995    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.776998    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777000    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777004    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777007    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777010    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777012    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777015    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777018    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777022    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777025    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777027    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.779949 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777031    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777036    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777040    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777043    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777046    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777050    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777054    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777059    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777062    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777065    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777068    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777071    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777074    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777076    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777079    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777082    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777085    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777088    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777090    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.780473 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777518    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777522    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777526    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777546    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777550    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777553    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777556    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777559    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777562    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777565    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777568    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777570    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777574    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777577    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777580    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777583    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777585    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777588    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777591    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.780980 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777594    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777597    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777599    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777602    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777605    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777608    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777611    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777613    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777616    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777619    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777622    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777624    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777627    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777630    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777633    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777636    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777638    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777643    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777648    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777651    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.781453 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777654    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777657    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777660    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777663    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777666    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777669    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777672    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777675    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777678    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777680    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777683    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777686    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777689    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777691    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777694    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777697    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777700    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777703    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777705    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777708    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.781979 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777711    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777713    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777717    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777719    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777722    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777725    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777728    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777731    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777734    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777737    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777739    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777743    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777746    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777751    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777754    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777757    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777761    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777766    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777769    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.782496 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777772    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777775    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777778    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777781    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777784    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777786    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777789    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777793    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777795    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777798    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777801    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777804    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777806    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777809    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777812    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777815    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777817    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777820    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777823    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.783011 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777826    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.777829    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777909    2547 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777917    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777933    2547 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777941    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777948    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777958    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777963    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777968    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777971    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777974    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777978    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777982    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777985    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777989    2547 flags.go:64] FLAG: --cgroup-root=""
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777992    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777995    2547 flags.go:64] FLAG: --client-ca-file=""
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.777998    2547 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778002    2547 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778008    2547 flags.go:64] FLAG: --cluster-domain=""
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778011    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778015    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778018    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 09:07:03.783494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778022    2547 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778026    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778030    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778033    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778036    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778039    2547 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778043    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778046    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778052    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778055    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778061    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778064    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778067    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778070    2547 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778073    2547 flags.go:64] FLAG: --enable-server="true"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778079    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778083    2547 flags.go:64] FLAG: --event-burst="100"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778087    2547 flags.go:64] FLAG: --event-qps="50"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778090    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778093    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778096    2547 flags.go:64] FLAG: --eviction-hard=""
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778100    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778104    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778107    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778110    2547 flags.go:64] FLAG: --eviction-soft=""
Jul 08 09:07:03.784153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778113    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778117    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778120    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778123    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778126    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778129    2547 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778132    2547 flags.go:64] FLAG: --feature-gates=""
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778136    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778139    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778143    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778146    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778149    2547 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778152    2547 flags.go:64] FLAG: --help="false"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778155    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-135-104.ec2.internal"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778159    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778163    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778166    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778170    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778174    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778177    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778180    2547 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778183    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778187    2547 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 09:07:03.784842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778191    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778195    2547 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778198    2547 flags.go:64] FLAG: --kube-reserved=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778201    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778204    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778207    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778210    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778214    2547 flags.go:64] FLAG: --lock-file=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778217    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778220    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778223    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778229    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778232    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778235    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778238    2547 flags.go:64] FLAG: --logging-format="text"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778241    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778244    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778247    2547 flags.go:64] FLAG: --manifest-url=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778250    2547 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778255    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778258    2547 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778263    2547 flags.go:64] FLAG: --max-pods="110"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778266    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778270    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778274    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 09:07:03.785461 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778277    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778280    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778283    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778287    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778295    2547 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778298    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778302    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778306    2547 flags.go:64] FLAG: --pod-cidr=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778310    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778316    2547 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778319    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778322    2547 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778325    2547 flags.go:64] FLAG: --port="10250"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778329    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778332    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03fe08ac3a56cf879"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778336    2547 flags.go:64] FLAG: --qos-reserved=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778339    2547 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778343    2547 flags.go:64] FLAG: --register-node="true"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778347    2547 flags.go:64] FLAG: --register-with-taints=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778351    2547 flags.go:64] FLAG: --registry-burst="10"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778354    2547 flags.go:64] FLAG: --registry-qps="5"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778357    2547 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778360    2547 flags.go:64] FLAG: --reserved-memory=""
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778365    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778368    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 09:07:03.786131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778372    2547 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778375    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778378    2547 flags.go:64] FLAG: --runonce="false"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778381    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778384    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778387    2547 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778392    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778395    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778398    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778401    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778405    2547 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778408    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778411    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778414    2547 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778418    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778421    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778425    2547 flags.go:64] FLAG: --system-cgroups=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778428    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778433    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778436    2547 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778439    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778444    2547 flags.go:64] FLAG: --tls-min-version=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778447    2547 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778450    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778454    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 09:07:03.786826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778457    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778460    2547 flags.go:64] FLAG: --v="2"
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778465    2547 flags.go:64] FLAG: --version="false"
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778472    2547 flags.go:64] FLAG: --vmodule=""
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778476    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.778479    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778625    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778629    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778632    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778635    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778657    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778661    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778664    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778669    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778672    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778675    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778678    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778681    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778684    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778686    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778689    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.787477 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778692    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778695    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778699    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778702    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778705    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778709    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778711    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778714    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778717    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778720    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778723    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778726    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778728    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778731    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778734    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778736    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778739    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778742    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778745    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778747    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.788090 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778750    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778753    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778756    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778758    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778762    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778765    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778768    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778770    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778773    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778776    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778780    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778784    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778787    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778790    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778793    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778797    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778801    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778804    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778807    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.788669 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778810    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778813    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778816    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778819    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778821    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778824    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778827    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778830    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778834    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778837    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778840    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778844    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778847    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778849    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778853    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778855    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778858    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778862    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778865    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778868    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.789170 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778870    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778873    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778876    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778880    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778883    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778886    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778889    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778892    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778895    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778898    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778902    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778904    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778907    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778910    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778912    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778915    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778918    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778920    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778923    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.789703 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778926    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778929    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778931    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778934    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778937    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.778940    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.779654    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.786950    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.786973    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.786992    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.786999    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787082    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787088    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787092    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.790187 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787095    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787099    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787102    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787105    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787108    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787111    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787113    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787116    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787119    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787123    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787127    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787130    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787133    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787136    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787139    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787142    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787144    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787147    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787150    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.790591 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787154    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787158    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787161    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787164    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787167    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787171    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787175    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787180    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787183    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787186    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787189    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787192    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787196    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787198    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787202    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787205    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787207    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787210    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787213    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787215    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.791104 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787218    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787221    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787224    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787227    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787231    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787235    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787238    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787241    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787245    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787248    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787250    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787254    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787256    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787259    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787262    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787265    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787267    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787270    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787273    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787277    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.791733 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787281    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787283    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787286    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787289    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787292    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787295    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787298    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787300    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787303    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787306    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787309    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787312    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787314    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787317    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787320    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787323    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787325    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787328    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787331    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787334    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.792245 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787336    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787339    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787342    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787344    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787347    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787350    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787353    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787355    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787358    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787361    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787364    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787367    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787371    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787374    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787377    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787380    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.792776 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787382    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.787388    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787519    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787525    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787544    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787550    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787553    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787556    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787559    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787562    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787565    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787568    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787571    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787575    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 09:07:03.793192 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787579    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787582    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787585    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787589    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787592    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787595    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787598    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787600    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787603    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787606    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787609    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787612    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787615    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787617    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787620    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787623    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787627    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787630    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787632    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787635    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 09:07:03.793676 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787638    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787641    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787644    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787646    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787649    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787652    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787655    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787658    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787660    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787663    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787666    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787669    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787672    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787674    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787677    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787680    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787683    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787686    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787690    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 09:07:03.794209 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787693    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787696    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787699    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787702    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787706    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787709    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787711    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787714    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787717    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787720    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787723    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787726    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787729    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787732    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787735    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787737    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787740    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787743    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787745    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787748    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 09:07:03.794707 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787751    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787754    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787757    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787759    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787762    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787765    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787767    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787770    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787773    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787776    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787778    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787781    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787784    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787787    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787790    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787793    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787796    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787799    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787801    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787804    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 09:07:03.795231 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787807    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787810    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787812    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787816    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787819    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787821    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787824    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:03.787827    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.787832    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.787968    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.790137    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.791589    2547 server.go:1019] "Starting client certificate rotation"
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.791713    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 09:07:03.795982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.791757    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 09:07:03.796520 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.794028    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 09:07:03.800454 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.800428    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 09:07:03.814164 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.814141    2547 log.go:25] "Validated CRI v1 runtime API"
Jul 08 09:07:03.816838 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.816806    2547 log.go:25] "Validated CRI v1 image API"
Jul 08 09:07:03.818575 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.818555    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 09:07:03.821154 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.821113    2547 fs.go:135] Filesystem UUIDs: map[68bdc228-3160-4539-82a1-b763b8364085:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ef36c52d-3dad-4c3f-ab42-de92b3b1ecbc:/dev/nvme0n1p3]
Jul 08 09:07:03.821154 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.821134    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 09:07:03.825068 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.825048    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 09:07:03.826910 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.826781    2547 manager.go:216] Machine: {Timestamp:2026-07-08 09:07:03.825377069 +0000 UTC m=+0.335150790 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098998 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28be8d44cd447f0fd1e0c2f6896748 SystemUUID:ec28be8d-44cd-447f-0fd1-e0c2f6896748 BootID:27417330-1d1c-45c8-a621-d84487ee7117 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:d2:16:12:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:d2:16:12:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:e4:5a:5c:ef:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 09:07:03.826910 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.826906    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 09:07:03.827018 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.827002    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 09:07:03.829147 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.829119    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 09:07:03.829311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.829149    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 09:07:03.829887 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.829877    2547 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 09:07:03.829923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.829891    2547 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 09:07:03.829923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.829899    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 09:07:03.830554 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.830542    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 09:07:03.831867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.831828    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 09:07:03.834996 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.834982    2547 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 09:07:03.835127 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835117    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 09:07:03.835158 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835149    2547 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 09:07:03.835187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835160    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 09:07:03.835187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835176    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 09:07:03.835241 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835188    2547 kubelet.go:398] "Adding apiserver pod source"
Jul 08 09:07:03.835241 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835198    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 09:07:03.835628 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835616    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 09:07:03.835669 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.835635    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 09:07:03.837856 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.837839    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 09:07:03.839797 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.839782    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 09:07:03.839842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.839816    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 09:07:03.841386 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841371    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841393    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841400    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841406    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841419    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841429    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841442    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 09:07:03.841450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841448    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 09:07:03.841673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841456    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 09:07:03.841673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841466    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 09:07:03.841673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841482    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 09:07:03.841673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.841488    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 09:07:03.843019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.843009    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 09:07:03.843019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.843020    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 09:07:03.846612 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.846596    2547 server.go:1268] "Started kubelet"
Jul 08 09:07:03.846715 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.846687    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 09:07:03.846805 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.846715    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 09:07:03.846855 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.846845    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 09:07:03.847761 ip-10-0-135-104 systemd[1]: Started Kubernetes Kubelet.
Jul 08 09:07:03.849879 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.849847    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 09:07:03.850525 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.850068    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 09:07:03.850525 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.850394    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 09:07:03.850679 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.850563    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 09:07:03.851868 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.851846    2547 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 09:07:03.853032 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.853003    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 09:07:03.857032 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.855998    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.ec2.internal.18c0454709b4f9b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.ec2.internal,UID:ip-10-0-135-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.ec2.internal,},FirstTimestamp:2026-07-08 09:07:03.846566328 +0000 UTC m=+0.356340049,LastTimestamp:2026-07-08 09:07:03.846566328 +0000 UTC m=+0.356340049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.ec2.internal,}"
Jul 08 09:07:03.859079 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859043    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 09:07:03.859231 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859075    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 09:07:03.859288 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.859242    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:03.860020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859738    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 09:07:03.860020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859765    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 09:07:03.860020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859808    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 09:07:03.860020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859919    2547 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 09:07:03.860020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.859927    2547 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 09:07:03.860807 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.860777    2547 factory.go:55] Registering systemd factory
Jul 08 09:07:03.860807 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.860800    2547 factory.go:223] Registration of the systemd container factory successfully
Jul 08 09:07:03.861149 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861129    2547 factory.go:153] Registering CRI-O factory
Jul 08 09:07:03.861149 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861152    2547 factory.go:223] Registration of the crio container factory successfully
Jul 08 09:07:03.861288 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861250    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 09:07:03.861288 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861242    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rm87d"
Jul 08 09:07:03.861288 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861284    2547 factory.go:103] Registering Raw factory
Jul 08 09:07:03.861403 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.861304    2547 manager.go:1196] Started watching for new ooms in manager
Jul 08 09:07:03.862078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.862058    2547 manager.go:349] Starting recovery of all containers
Jul 08 09:07:03.862743 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.862712    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 09:07:03.863672 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.863640    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 09:07:03.871658 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.871366    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rm87d"
Jul 08 09:07:03.873842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.873804    2547 manager.go:354] Recovery completed
Jul 08 09:07:03.879092 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.879068    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:03.882077 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882054    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:03.882215 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882094    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:03.882215 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882106    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:03.882734 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882718    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 09:07:03.882784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882735    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 09:07:03.882784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882748    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:03.882784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.882764    2547 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 09:07:03.883795 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.883777    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:03.883885 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.883809    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:03.883885 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.883824    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:03.884145 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.884129    2547 policy_none.go:49] "None policy: Start"
Jul 08 09:07:03.884214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.884150    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 09:07:03.884214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.884166    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 09:07:03.884357 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.884263    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.ec2.internal.18c045470bd2d79d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.ec2.internal,UID:ip-10-0-135-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.ec2.internal,},FirstTimestamp:2026-07-08 09:07:03.882078109 +0000 UTC m=+0.391851829,LastTimestamp:2026-07-08 09:07:03.882078109 +0000 UTC m=+0.391851829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.ec2.internal,}"
Jul 08 09:07:03.885311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.885297    2547 policy_none.go:47] "Start"
Jul 08 09:07:03.920232 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920203    2547 manager.go:337] "Starting Device Plugin manager"
Jul 08 09:07:03.920348 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.920254    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 09:07:03.920348 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920269    2547 server.go:87] "Starting device plugin registration server"
Jul 08 09:07:03.920612 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920599    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 09:07:03.920676 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920613    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 09:07:03.920760 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920735    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 09:07:03.920857 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920844    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 09:07:03.920857 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:03.920856    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 09:07:03.921428 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.921404    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 09:07:03.921551 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:03.921467    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.021746 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.021699    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:04.023276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.022760    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:04.023276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.022794    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:04.023276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.022807    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:04.023276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.022838    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.026565 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.026517    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 09:07:04.027893 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.027878    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 09:07:04.027978 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.027925    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 09:07:04.027978 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.027960    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 09:07:04.028087 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.028008    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 09:07:04.030174 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.030150    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:04.031691 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.031672    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.031784 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.031702    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-104.ec2.internal\": node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.087397 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.087299    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.129772 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.129732    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"]
Jul 08 09:07:04.129906 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.129838    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:04.131544 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.131516    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:04.131628 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.131550    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:04.131628 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.131566    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:04.133075 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133060    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:04.133185 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133168    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.133258 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133202    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:04.133882 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133866    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:04.133985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133895    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:04.133985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133907    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:04.133985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133867    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:04.133985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133977    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:04.133985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.133989    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:04.135093 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.135076    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.135168 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.135105    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 09:07:04.135923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.135906    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 09:07:04.136012 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.135940    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 09:07:04.136012 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.135955    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 09:07:04.158676 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.158645    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-104.ec2.internal\" not found" node="ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.162445 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.161897    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/190de35898b6b85a611194d4297a6c4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.ec2.internal\" (UID: \"190de35898b6b85a611194d4297a6c4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.162445 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.161929    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.162445 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.161950    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.175491 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.175469    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-104.ec2.internal\" not found" node="ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.188438 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.188405    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.262572 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262540    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/190de35898b6b85a611194d4297a6c4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.ec2.internal\" (UID: \"190de35898b6b85a611194d4297a6c4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.262572 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262575    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.262789 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.262789 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262661    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.262789 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262674    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/190de35898b6b85a611194d4297a6c4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.ec2.internal\" (UID: \"190de35898b6b85a611194d4297a6c4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.262789 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.262726    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b003598a660c3ddf5966bb2c7b709083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal\" (UID: \"b003598a660c3ddf5966bb2c7b709083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.289261 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.289213    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.390642 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.390614    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.464045 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.464013    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.479330 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.479291    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.491296 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.491260    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.591739 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.591678    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-104.ec2.internal\" not found"
Jul 08 09:07:04.673593 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.673508    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:04.760130 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.760083    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.780607 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.780579    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 09:07:04.782544 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.782523    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.790808 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.790766    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 09:07:04.790959 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.790839    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:04.790959 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.790928    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 09:07:04.791079 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.790974    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 09:07:04.791079 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.791005    2547 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://ab2b3770847554367a9d0d96623f9d55-823ec050f261bb6e.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.135.104:38180->3.218.104.186:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal"
Jul 08 09:07:04.836608 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.836562    2547 apiserver.go:52] "Watching apiserver"
Jul 08 09:07:04.848617 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.848583    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 09:07:04.848986 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.848960    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-z2h8f","openshift-ovn-kubernetes/ovnkube-node-mwrk6","kube-system/konnectivity-agent-hj9wl","kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dznzv","openshift-dns/node-resolver-9jqnv","openshift-image-registry/node-ca-b7jv4","openshift-multus/multus-additional-cni-plugins-6bc4x","openshift-multus/network-metrics-daemon-dmn8b","openshift-network-diagnostics/network-check-target-zpnxl","kube-system/global-pull-secret-syncer-mzmh8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal","openshift-multus/multus-wj7vk"]
Jul 08 09:07:04.850489 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.850458    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:04.850568 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.850541    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:04.851637 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.851612    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.851721 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.851699    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:04.853309 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.853288    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.854497 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.854471    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.855837 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.855816    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.856540 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.856451    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sdztk\""
Jul 08 09:07:04.856540 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.856451    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 09:07:04.856540 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.856463    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 09:07:04.857142 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.857125    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.857692 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.857675    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b2d89\""
Jul 08 09:07:04.857810 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.857793    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 09:07:04.857848 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.857793    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.858128 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.858110    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.858273 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.858254    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 09:07:04.858891 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.858870    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:04.858975 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.858953    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:04.859204 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.859189    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 09:07:04.859424 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.859409    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.859682 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.859665    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wg45b\""
Jul 08 09:07:04.860555 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.860536    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.861301 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.861278    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.861387 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.861304    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.861387 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.861325    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.861508 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.861432    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4x8v9\""
Jul 08 09:07:04.861974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.861960    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.863214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.863196    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:04.864628 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.864609    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:04.865775 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.865757    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 09:07:04.865991 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.865974    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.866516 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866500    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 09:07:04.866616 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866599    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p5wv\" (UniqueName: \"kubernetes.io/projected/c825181a-a9c4-4525-8d8c-523152e46fdb-kube-api-access-9p5wv\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.866656 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-conf\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.866691 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866678    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-var-lib-kubelet\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.866727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866709    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-tmp\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.866762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866738    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-hostroot\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.866762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866756    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-daemon-config\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.866837 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866778    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.866837 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866806    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-kubernetes\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.866837 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866824    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzhc5\" (UniqueName: \"kubernetes.io/projected/84c5ea3a-913c-4267-874d-f9dce96b4f97-kube-api-access-zzhc5\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.866979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-tmp-dir\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.866979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866865    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cnibin\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.866979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.866979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866948    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999tq\" (UniqueName: \"kubernetes.io/projected/734c02dc-c843-4064-80e0-1fa52fc9e9ba-kube-api-access-999tq\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.866985    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71affc53-ce18-464f-b286-5a85131e8173-agent-certs\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867006    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71affc53-ce18-464f-b286-5a85131e8173-konnectivity-ca\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867040    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867077    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckdv\" (UniqueName: \"kubernetes.io/projected/19616da9-862e-494b-b920-5c310a8d7243-kube-api-access-fckdv\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867105    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-k8s-cni-cncf-io\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867123    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-netns\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867253    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-conf-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867283    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-os-release\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867307    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867327    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-sys\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867348    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-host\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867382    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-tuned\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867415    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-etc-kubernetes\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867444    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-kubelet-config\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867565    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-dbus\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-systemd\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-run\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867646    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-hosts-file\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867685    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867718    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-bin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-modprobe-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867778    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-lib-modules\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867804    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtq87\" (UniqueName: \"kubernetes.io/projected/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-kube-api-access-jtq87\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867832    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-multus\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867860    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-system-cni-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867882    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.867907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867904    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-cni-binary-copy\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867929    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysconfig\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867948    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-multus-certs\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867965    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-system-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867980    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.867995    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-cnibin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.868011    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-os-release\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.868026    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.868060    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-socket-dir-parent\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.868221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.868093    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-kubelet\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.871411 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.871389    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ps99l\""
Jul 08 09:07:04.871616 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.871594    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.871693 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.871615    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.871693 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.871675    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 09:07:04.871928 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.871912    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 09:07:04.872740 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.872716    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 09:07:04.872848 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.872748    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873015    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873044    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873085    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873088    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873159    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873138    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 09:07:04.873280 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.873138    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 09:07:04.874416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.874322    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mt7gs\""
Jul 08 09:07:04.874416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.874342    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mb8ts\""
Jul 08 09:07:04.874416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.874372    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zn6wp\""
Jul 08 09:07:04.874897 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.874874    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ch98w\""
Jul 08 09:07:04.875083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.875066    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 09:07:04.876548 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.876039    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 09:02:04 +0000 UTC" deadline="2028-03-20 16:50:58.262326952 +0000 UTC"
Jul 08 09:07:04.876548 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.876093    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14911h43m53.386238284s"
Jul 08 09:07:04.876548 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.876136    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 09:07:04.889437 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.889395    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 09:07:04.930988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.930959    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fj2qm"
Jul 08 09:07:04.943419 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.943392    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fj2qm"
Jul 08 09:07:04.960729 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.960692    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 09:07:04.968655 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-ovn\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.968655 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-env-overrides\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968687    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bd44263-6841-48d6-8b54-5ad791278672-iptables-alerter-script\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968716    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-multus\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968742    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968782    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-multus\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968811    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-cni-binary-copy\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968851    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysconfig\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968880    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-kubelet\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.968902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968906    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-multus-certs\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968931    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-cnibin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.968985    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysconfig\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969013    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-multus-certs\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969010    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-etc-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969062    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969060    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-cnibin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969088    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969110    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-sys-fs\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969194    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969226    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-socket-dir-parent\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-kubelet\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969326    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-socket-dir-parent\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969363    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-systemd-units\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969391    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-log-socket\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969390    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969402    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969436    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-kubelet\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969478    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-cni-binary-copy\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969492    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-daemon-config\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969544    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969622    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-tmp-dir\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.969688    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969727    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cnibin\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969762    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969778    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cnibin\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.969881    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:05.469837664 +0000 UTC m=+1.979611402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969899    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999tq\" (UniqueName: \"kubernetes.io/projected/734c02dc-c843-4064-80e0-1fa52fc9e9ba-kube-api-access-999tq\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.969927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969925    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71affc53-ce18-464f-b286-5a85131e8173-konnectivity-ca\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969951    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969980    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-var-lib-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.969992    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-tmp-dir\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970021    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-daemon-config\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970002    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-node-log\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970077    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970107    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-k8s-cni-cncf-io\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970137    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-conf-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970164    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970189    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-sys\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.970199    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970215    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-tuned\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970242    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-hosts-file\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:04.970260    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:05.470242122 +0000 UTC m=+1.980015844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970260    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-multus-conf-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970291    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dmv\" (UniqueName: \"kubernetes.io/projected/7097b115-b2cd-474a-86d2-4b83f0a14cdf-kube-api-access-b5dmv\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.970821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970300    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-k8s-cni-cncf-io\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970322    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3923a524-da38-4f1b-820b-c587360b2aa7-host\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970328    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-etc-kubernetes\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970294    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-hosts-file\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970366    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-dbus\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970405    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-sys\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970430    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970453    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-etc-kubernetes\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970500    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5bcx\" (UniqueName: \"kubernetes.io/projected/5bd44263-6841-48d6-8b54-5ad791278672-kube-api-access-z5bcx\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970503    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-dbus\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970554    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3923a524-da38-4f1b-820b-c587360b2aa7-serviceca\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970582    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970625    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71affc53-ce18-464f-b286-5a85131e8173-konnectivity-ca\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970656    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-lib-modules\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970676    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-netd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-config\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970732    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bd44263-6841-48d6-8b54-5ad791278672-host-slash\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:04.971661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970731    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970761    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-system-cni-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970790    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-system-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970830    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-lib-modules\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970845    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-os-release\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970869    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-systemd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970856    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-system-cni-dir\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970892    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970877    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-system-cni-dir\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970914    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-registration-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970936    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-os-release\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970946    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p5wv\" (UniqueName: \"kubernetes.io/projected/c825181a-a9c4-4525-8d8c-523152e46fdb-kube-api-access-9p5wv\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970979    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-conf\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.970998    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734c02dc-c843-4064-80e0-1fa52fc9e9ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971007    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-var-lib-kubelet\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971033    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-tmp\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.972556 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971056    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-hostroot\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971081    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-kubernetes\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzhc5\" (UniqueName: \"kubernetes.io/projected/84c5ea3a-913c-4267-874d-f9dce96b4f97-kube-api-access-zzhc5\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971137    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-device-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971140    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-sysctl-conf\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971183    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94k4\" (UniqueName: \"kubernetes.io/projected/4ff9417c-ef70-4444-aa63-72d47986ba1c-kube-api-access-p94k4\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971216    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71affc53-ce18-464f-b286-5a85131e8173-agent-certs\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971277    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971302    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-var-lib-kubelet\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971307    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-kubernetes\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971344    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-hostroot\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckdv\" (UniqueName: \"kubernetes.io/projected/19616da9-862e-494b-b920-5c310a8d7243-kube-api-access-fckdv\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971393    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-slash\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971425    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-script-lib\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971495    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkqpg\" (UniqueName: \"kubernetes.io/projected/3923a524-da38-4f1b-820b-c587360b2aa7-kube-api-access-kkqpg\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971525    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-socket-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-netns\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.973363 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971611    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-os-release\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971646    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-run-netns\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971636    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-host\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971688    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971719    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-kubelet-config\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971779    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-systemd\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971808    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-run\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971817    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-host\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971775    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734c02dc-c843-4064-80e0-1fa52fc9e9ba-os-release\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971845    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f38273-da84-4f9c-84cc-b9c6a2285fdd-kubelet-config\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971849    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-netns\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971879    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-run\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971903    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-systemd\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-bin\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971950    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-bin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.971979    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-modprobe-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.972013    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c825181a-a9c4-4525-8d8c-523152e46fdb-host-var-lib-cni-bin\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.974299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.972067    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtq87\" (UniqueName: \"kubernetes.io/projected/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-kube-api-access-jtq87\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:04.975099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.972378    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-modprobe-d\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.975099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.974694    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-tmp\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.975099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.974715    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c5ea3a-913c-4267-874d-f9dce96b4f97-etc-tuned\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:04.975099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.975016    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71affc53-ce18-464f-b286-5a85131e8173-agent-certs\") pod \"konnectivity-agent-hj9wl\" (UID: \"71affc53-ce18-464f-b286-5a85131e8173\") " pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:04.982527 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.982489    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p5wv\" (UniqueName: \"kubernetes.io/projected/c825181a-a9c4-4525-8d8c-523152e46fdb-kube-api-access-9p5wv\") pod \"multus-wj7vk\" (UID: \"c825181a-a9c4-4525-8d8c-523152e46fdb\") " pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:04.987220 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:04.987191    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-999tq\" (UniqueName: \"kubernetes.io/projected/734c02dc-c843-4064-80e0-1fa52fc9e9ba-kube-api-access-999tq\") pod \"multus-additional-cni-plugins-6bc4x\" (UID: \"734c02dc-c843-4064-80e0-1fa52fc9e9ba\") " pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:05.004874 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.004842    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:05.004874 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.004877    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:05.005064 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.004893    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:05.005064 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.004978    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:05.504955676 +0000 UTC m=+2.014729387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:05.005743 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.005711    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtq87\" (UniqueName: \"kubernetes.io/projected/a5b73df2-ed31-43aa-8d3f-65fbbdf67185-kube-api-access-jtq87\") pod \"node-resolver-9jqnv\" (UID: \"a5b73df2-ed31-43aa-8d3f-65fbbdf67185\") " pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:05.006633 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.006590    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190de35898b6b85a611194d4297a6c4e.slice/crio-73f75a2d8e3769413dbcb6d21ae0e87df97b1a5e78172e6556d4daab2f095ac6 WatchSource:0}: Error finding container 73f75a2d8e3769413dbcb6d21ae0e87df97b1a5e78172e6556d4daab2f095ac6: Status 404 returned error can't find the container with id 73f75a2d8e3769413dbcb6d21ae0e87df97b1a5e78172e6556d4daab2f095ac6
Jul 08 09:07:05.007233 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.007210    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckdv\" (UniqueName: \"kubernetes.io/projected/19616da9-862e-494b-b920-5c310a8d7243-kube-api-access-fckdv\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:05.007526 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.007503    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb003598a660c3ddf5966bb2c7b709083.slice/crio-c3123c4aefc4dfbd7408132cc5ceac907dd1a82d424da7a65f8500a4d924b676 WatchSource:0}: Error finding container c3123c4aefc4dfbd7408132cc5ceac907dd1a82d424da7a65f8500a4d924b676: Status 404 returned error can't find the container with id c3123c4aefc4dfbd7408132cc5ceac907dd1a82d424da7a65f8500a4d924b676
Jul 08 09:07:05.008353 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.008333    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzhc5\" (UniqueName: \"kubernetes.io/projected/84c5ea3a-913c-4267-874d-f9dce96b4f97-kube-api-access-zzhc5\") pod \"tuned-dznzv\" (UID: \"84c5ea3a-913c-4267-874d-f9dce96b4f97\") " pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:05.009421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.009403    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:05.012229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.012213    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 09:07:05.032726 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.032668    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal" event={"ID":"190de35898b6b85a611194d4297a6c4e","Type":"ContainerStarted","Data":"73f75a2d8e3769413dbcb6d21ae0e87df97b1a5e78172e6556d4daab2f095ac6"}
Jul 08 09:07:05.033820 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.033791    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal" event={"ID":"b003598a660c3ddf5966bb2c7b709083","Type":"ContainerStarted","Data":"c3123c4aefc4dfbd7408132cc5ceac907dd1a82d424da7a65f8500a4d924b676"}
Jul 08 09:07:05.073101 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073040    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-log-socket\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-var-lib-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073132    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-node-log\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073168    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dmv\" (UniqueName: \"kubernetes.io/projected/7097b115-b2cd-474a-86d2-4b83f0a14cdf-kube-api-access-b5dmv\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073176    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-log-socket\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073189    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-var-lib-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073194    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-node-log\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3923a524-da38-4f1b-820b-c587360b2aa7-host\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073219    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3923a524-da38-4f1b-820b-c587360b2aa7-host\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5bcx\" (UniqueName: \"kubernetes.io/projected/5bd44263-6841-48d6-8b54-5ad791278672-kube-api-access-z5bcx\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.073282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073277    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3923a524-da38-4f1b-820b-c587360b2aa7-serviceca\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073405    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073422    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-netd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073489    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-config\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073506    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-netd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073521    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bd44263-6841-48d6-8b54-5ad791278672-host-slash\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073550    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073579    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-systemd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073604    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bd44263-6841-48d6-8b54-5ad791278672-host-slash\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073672    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-systemd\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073713    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-registration-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073756    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-device-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073768    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.073794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073784    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94k4\" (UniqueName: \"kubernetes.io/projected/4ff9417c-ef70-4444-aa63-72d47986ba1c-kube-api-access-p94k4\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073811    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-registration-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073833    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3923a524-da38-4f1b-820b-c587360b2aa7-serviceca\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-slash\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073851    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-device-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073877    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-script-lib\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073906    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkqpg\" (UniqueName: \"kubernetes.io/projected/3923a524-da38-4f1b-820b-c587360b2aa7-kube-api-access-kkqpg\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073906    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-slash\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073933    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-socket-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073965    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.073994    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-netns\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074017    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-bin\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074022    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-config\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074044    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-ovn\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074071    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-env-overrides\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074081    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-netns\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bd44263-6841-48d6-8b54-5ad791278672-iptables-alerter-script\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.074496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074095    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074102    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-socket-dir\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074131    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-ovn\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074142    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-kubelet\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074160    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-cni-bin\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074180    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-etc-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074203    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-kubelet\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074239    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074244    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-etc-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074285    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074286    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-run-openvswitch\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074311    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-sys-fs\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074348    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-systemd-units\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074391    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff9417c-ef70-4444-aa63-72d47986ba1c-sys-fs\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074415    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7097b115-b2cd-474a-86d2-4b83f0a14cdf-systemd-units\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074493    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-env-overrides\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074504    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovnkube-script-lib\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.075602 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.074719    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bd44263-6841-48d6-8b54-5ad791278672-iptables-alerter-script\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.076250 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.076232    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7097b115-b2cd-474a-86d2-4b83f0a14cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.087139 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.087103    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94k4\" (UniqueName: \"kubernetes.io/projected/4ff9417c-ef70-4444-aa63-72d47986ba1c-kube-api-access-p94k4\") pod \"aws-ebs-csi-driver-node-dgc5l\" (UID: \"4ff9417c-ef70-4444-aa63-72d47986ba1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.087262 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.087137    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dmv\" (UniqueName: \"kubernetes.io/projected/7097b115-b2cd-474a-86d2-4b83f0a14cdf-kube-api-access-b5dmv\") pod \"ovnkube-node-mwrk6\" (UID: \"7097b115-b2cd-474a-86d2-4b83f0a14cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.087262 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.087153    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5bcx\" (UniqueName: \"kubernetes.io/projected/5bd44263-6841-48d6-8b54-5ad791278672-kube-api-access-z5bcx\") pod \"iptables-alerter-z2h8f\" (UID: \"5bd44263-6841-48d6-8b54-5ad791278672\") " pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.087262 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.087243    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkqpg\" (UniqueName: \"kubernetes.io/projected/3923a524-da38-4f1b-820b-c587360b2aa7-kube-api-access-kkqpg\") pod \"node-ca-b7jv4\" (UID: \"3923a524-da38-4f1b-820b-c587360b2aa7\") " pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.181722 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.181617    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:05.190961 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.190933    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71affc53_ce18_464f_b286_5a85131e8173.slice/crio-2f7b6fe2a9670c4daebc92f2789dde9e1d1375ce9ba6b9d0cde4b8928b99c294 WatchSource:0}: Error finding container 2f7b6fe2a9670c4daebc92f2789dde9e1d1375ce9ba6b9d0cde4b8928b99c294: Status 404 returned error can't find the container with id 2f7b6fe2a9670c4daebc92f2789dde9e1d1375ce9ba6b9d0cde4b8928b99c294
Jul 08 09:07:05.197326 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.197301    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wj7vk"
Jul 08 09:07:05.204717 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.204687    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc825181a_a9c4_4525_8d8c_523152e46fdb.slice/crio-eb4bc8a60ae4c708555078d8a20e062d945dc926dc385dca312e1d3ef89f4af8 WatchSource:0}: Error finding container eb4bc8a60ae4c708555078d8a20e062d945dc926dc385dca312e1d3ef89f4af8: Status 404 returned error can't find the container with id eb4bc8a60ae4c708555078d8a20e062d945dc926dc385dca312e1d3ef89f4af8
Jul 08 09:07:05.213930 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.213908    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dznzv"
Jul 08 09:07:05.221264 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.221238    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c5ea3a_913c_4267_874d_f9dce96b4f97.slice/crio-e71d528d10b45157cf96dfe691b0f4de479f6195504ec0a14f7eda384b1874ab WatchSource:0}: Error finding container e71d528d10b45157cf96dfe691b0f4de479f6195504ec0a14f7eda384b1874ab: Status 404 returned error can't find the container with id e71d528d10b45157cf96dfe691b0f4de479f6195504ec0a14f7eda384b1874ab
Jul 08 09:07:05.221981 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.221959    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jqnv"
Jul 08 09:07:05.231017 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.230989    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b73df2_ed31_43aa_8d3f_65fbbdf67185.slice/crio-f2806e53c110a6b745aae477cdba097b1a9b1f4a1e3d2409132a8d19cf243a69 WatchSource:0}: Error finding container f2806e53c110a6b745aae477cdba097b1a9b1f4a1e3d2409132a8d19cf243a69: Status 404 returned error can't find the container with id f2806e53c110a6b745aae477cdba097b1a9b1f4a1e3d2409132a8d19cf243a69
Jul 08 09:07:05.238831 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.238811    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6bc4x"
Jul 08 09:07:05.246588 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.246564    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734c02dc_c843_4064_80e0_1fa52fc9e9ba.slice/crio-2554b9e20e4e3977acbcc30bc5f930eb4fbc4ca41ba5f21d5bf139fcadb39b0f WatchSource:0}: Error finding container 2554b9e20e4e3977acbcc30bc5f930eb4fbc4ca41ba5f21d5bf139fcadb39b0f: Status 404 returned error can't find the container with id 2554b9e20e4e3977acbcc30bc5f930eb4fbc4ca41ba5f21d5bf139fcadb39b0f
Jul 08 09:07:05.247576 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.247555    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:05.255262 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.255239    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7097b115_b2cd_474a_86d2_4b83f0a14cdf.slice/crio-492eeeb2ca3527181ed9fa56d97f0f73ed60ebdd49e15de814e5d5878d10b1c2 WatchSource:0}: Error finding container 492eeeb2ca3527181ed9fa56d97f0f73ed60ebdd49e15de814e5d5878d10b1c2: Status 404 returned error can't find the container with id 492eeeb2ca3527181ed9fa56d97f0f73ed60ebdd49e15de814e5d5878d10b1c2
Jul 08 09:07:05.274251 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.274220    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z2h8f"
Jul 08 09:07:05.281909 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.281881    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd44263_6841_48d6_8b54_5ad791278672.slice/crio-72a03301ffc53b91a7b77d84bdd7f6a7bdd9abf723adec78ff61f341507a5c45 WatchSource:0}: Error finding container 72a03301ffc53b91a7b77d84bdd7f6a7bdd9abf723adec78ff61f341507a5c45: Status 404 returned error can't find the container with id 72a03301ffc53b91a7b77d84bdd7f6a7bdd9abf723adec78ff61f341507a5c45
Jul 08 09:07:05.287722 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.287701    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7jv4"
Jul 08 09:07:05.295555 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.295532    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3923a524_da38_4f1b_820b_c587360b2aa7.slice/crio-aab8cfb5a62709af1aa72952692882172dc70417144b361067b33fd1e6da05ca WatchSource:0}: Error finding container aab8cfb5a62709af1aa72952692882172dc70417144b361067b33fd1e6da05ca: Status 404 returned error can't find the container with id aab8cfb5a62709af1aa72952692882172dc70417144b361067b33fd1e6da05ca
Jul 08 09:07:05.301741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.301718    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l"
Jul 08 09:07:05.309216 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:05.309185    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff9417c_ef70_4444_aa63_72d47986ba1c.slice/crio-31e47642a538e97cff20e7e108d5fab362e5d90ea9de022838c2fd27aeae01a1 WatchSource:0}: Error finding container 31e47642a538e97cff20e7e108d5fab362e5d90ea9de022838c2fd27aeae01a1: Status 404 returned error can't find the container with id 31e47642a538e97cff20e7e108d5fab362e5d90ea9de022838c2fd27aeae01a1
Jul 08 09:07:05.477768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.477668    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:05.477768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.477725    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:05.478000 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.477863    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:05.478000 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.477937    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:06.477916811 +0000 UTC m=+2.987690520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:05.478000 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.477865    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:05.478227 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.478027    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:06.478006678 +0000 UTC m=+2.987780386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:05.578150 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.578106    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:05.578373 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.578353    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:05.578453 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.578382    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:05.578453 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.578395    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:05.578580 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:05.578481    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:06.578448089 +0000 UTC m=+3.088221803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:05.948003 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.947923    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 09:02:05 +0000 UTC" deadline="2028-04-19 05:09:43.964290922 +0000 UTC"
Jul 08 09:07:05.948859 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:05.948039    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15620h2m38.016257073s"
Jul 08 09:07:06.029005 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.028968    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:06.029220 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.029145    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:06.062969 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.062847    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z2h8f" event={"ID":"5bd44263-6841-48d6-8b54-5ad791278672","Type":"ContainerStarted","Data":"72a03301ffc53b91a7b77d84bdd7f6a7bdd9abf723adec78ff61f341507a5c45"}
Jul 08 09:07:06.079043 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.078996    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"492eeeb2ca3527181ed9fa56d97f0f73ed60ebdd49e15de814e5d5878d10b1c2"}
Jul 08 09:07:06.095895 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.095849    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jqnv" event={"ID":"a5b73df2-ed31-43aa-8d3f-65fbbdf67185","Type":"ContainerStarted","Data":"f2806e53c110a6b745aae477cdba097b1a9b1f4a1e3d2409132a8d19cf243a69"}
Jul 08 09:07:06.128007 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.127864    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dznzv" event={"ID":"84c5ea3a-913c-4267-874d-f9dce96b4f97","Type":"ContainerStarted","Data":"e71d528d10b45157cf96dfe691b0f4de479f6195504ec0a14f7eda384b1874ab"}
Jul 08 09:07:06.163380 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.163248    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wj7vk" event={"ID":"c825181a-a9c4-4525-8d8c-523152e46fdb","Type":"ContainerStarted","Data":"eb4bc8a60ae4c708555078d8a20e062d945dc926dc385dca312e1d3ef89f4af8"}
Jul 08 09:07:06.192185 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.192023    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj9wl" event={"ID":"71affc53-ce18-464f-b286-5a85131e8173","Type":"ContainerStarted","Data":"2f7b6fe2a9670c4daebc92f2789dde9e1d1375ce9ba6b9d0cde4b8928b99c294"}
Jul 08 09:07:06.200271 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.199924    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l" event={"ID":"4ff9417c-ef70-4444-aa63-72d47986ba1c","Type":"ContainerStarted","Data":"31e47642a538e97cff20e7e108d5fab362e5d90ea9de022838c2fd27aeae01a1"}
Jul 08 09:07:06.219861 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.219768    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7jv4" event={"ID":"3923a524-da38-4f1b-820b-c587360b2aa7","Type":"ContainerStarted","Data":"aab8cfb5a62709af1aa72952692882172dc70417144b361067b33fd1e6da05ca"}
Jul 08 09:07:06.223836 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.223687    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerStarted","Data":"2554b9e20e4e3977acbcc30bc5f930eb4fbc4ca41ba5f21d5bf139fcadb39b0f"}
Jul 08 09:07:06.332442 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.332189    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:06.486705 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.486607    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:06.486705 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.486662    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:06.486942 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.486783    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:06.486942 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.486829    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:06.486942 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.486861    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:08.486838629 +0000 UTC m=+4.996612339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:06.486942 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.486887    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:08.486874319 +0000 UTC m=+4.996648031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:06.588483 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.587659    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:06.588483 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.587899    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:06.588483 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.587921    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:06.588483 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.587935    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:06.588483 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:06.588012    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:08.587992476 +0000 UTC m=+5.097766197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:06.719207 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.719173    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 09:07:06.948767 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.948722    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 09:02:05 +0000 UTC" deadline="2027-12-07 20:14:55.593053663 +0000 UTC"
Jul 08 09:07:06.948767 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:06.948765    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12419h7m48.644293666s"
Jul 08 09:07:07.029198 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:07.029160    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:07.029409 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:07.029307    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:07.029784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:07.029764    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:07.029902 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:07.029874    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:08.031018 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:08.030932    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:08.031512 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.031166    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:08.507418 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:08.507369    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:08.507648 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:08.507437    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:08.507648 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.507627    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:08.507791 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.507700    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:12.507679056 +0000 UTC m=+9.017452780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:08.507872 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.507790    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:08.507872 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.507828    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:12.507816252 +0000 UTC m=+9.017589974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:08.608433 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:08.608293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:08.608647 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.608526    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:08.608647 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.608554    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:08.608647 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.608570    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:08.608647 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:08.608645    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:12.608622552 +0000 UTC m=+9.118396275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:09.028867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:09.028834    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:09.029061 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:09.028834    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:09.029061 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:09.028976    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:09.029061 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:09.029004    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:10.028861 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:10.028648    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:10.029852 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:10.029346    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:11.028908 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:11.028860    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:11.028908 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:11.028910    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:11.029477 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:11.029006    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:11.029477 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:11.029093    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:12.030734 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:12.030362    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:12.031181 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.030768    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:12.547383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:12.547342    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:12.547383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:12.547399    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:12.547656 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.547555    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:12.547656 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.547620    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:20.547600905 +0000 UTC m=+17.057374634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:12.547765 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.547731    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:12.547854 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.547832    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:20.547787101 +0000 UTC m=+17.057560819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:12.648571 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:12.648530    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:12.648785 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.648731    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:12.648785 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.648790    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:12.648980 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.648804    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:12.648980 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:12.648874    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:20.648853644 +0000 UTC m=+17.158627362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:13.028510 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:13.028474    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:13.028708 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:13.028520    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:13.028708 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:13.028625    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:13.028819 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:13.028743    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:14.029474 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:14.029420    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:14.029920 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:14.029580    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:15.029160 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:15.029122    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:15.029317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:15.029122    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:15.029317 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:15.029248    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:15.029450 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:15.029320    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:16.028449 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:16.028411    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:16.028864 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:16.028580    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:17.028900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:17.028866    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:17.029353 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:17.028920    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:17.029353 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:17.029003    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:17.029353 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:17.029099    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:18.028770 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:18.028738    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:18.028912 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:18.028886    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:19.028196 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:19.028158    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:19.028661 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:19.028158    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:19.028661 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:19.028279    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:19.028661 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:19.028361    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:20.029076 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:20.029041    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:20.029519 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.029188    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:20.613681 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:20.613637    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:20.613909 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:20.613690    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:20.613909 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.613870    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:20.614024 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.613943    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:36.613923643 +0000 UTC m=+33.123697362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:20.614024 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.613868    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:20.614130 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.614024    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:07:36.614008226 +0000 UTC m=+33.123781930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:20.714243 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:20.714199    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:20.714427 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.714403    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:20.714513 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.714436    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:20.714513 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.714468    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:20.714604 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:20.714534    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:36.714514405 +0000 UTC m=+33.224288115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:21.029052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:21.029018    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:21.029226 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:21.029018    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:21.029226 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:21.029142    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:21.029226 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:21.029193    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:22.029135 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:22.029097    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:22.029364 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:22.029248    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:23.028841 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:23.028801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:23.029038 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:23.028801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:23.029038 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:23.028940    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:23.029156 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:23.029053    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:24.029484 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:24.029438    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:24.029943 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:24.029581    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:25.029043 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:25.029007    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:25.029221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:25.029007    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:25.029221 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:25.029124    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:25.029221 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:25.029199    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:26.028801 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.028773    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:26.029656 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:26.028902    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:26.276820 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.276797    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:07:26.277142 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277122    2547 generic.go:356] "Generic (PLEG): container finished" podID="7097b115-b2cd-474a-86d2-4b83f0a14cdf" containerID="49666a00486825fee96460b460ee3d372f5216caf15648ee921cc3352356a796" exitCode=1
Jul 08 09:07:26.277199 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277178    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"0b054386138dd925bdfe4eaa2b56f296cb355ebe3dc1ed06beeef4d24106a3a5"}
Jul 08 09:07:26.277258 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277241    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"616ed541a4c8af3ae7e4e23e9cf3359a13a282297306baddded3d90d0acb1ea0"}
Jul 08 09:07:26.277311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277290    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"60934f37b0e7895b5928492503df7781f69c86d46f4c7cbb46f93ece8f8a354e"}
Jul 08 09:07:26.277361 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277324    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerDied","Data":"49666a00486825fee96460b460ee3d372f5216caf15648ee921cc3352356a796"}
Jul 08 09:07:26.277361 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.277354    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"8baf407f1f72311ddb5d1a83a5d5f357cdf32dfec0c0cd057feb34ce83cd510e"}
Jul 08 09:07:26.278906 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.278883    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dznzv" event={"ID":"84c5ea3a-913c-4267-874d-f9dce96b4f97","Type":"ContainerStarted","Data":"c8437fa8254ec6c9f35cd5beecaa9f01fae170fdaefaf643d8b1e7197c2a8842"}
Jul 08 09:07:26.280310 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.280289    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wj7vk" event={"ID":"c825181a-a9c4-4525-8d8c-523152e46fdb","Type":"ContainerStarted","Data":"45253ad20f698fcab51024528cc95fd3f6e0b3d8bbb5b313a57f1d298103064c"}
Jul 08 09:07:26.281987 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.281966    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal" event={"ID":"190de35898b6b85a611194d4297a6c4e","Type":"ContainerStarted","Data":"db4b55ea9a019a3b452171885055d8ceab3dd34454e47a0f7aca8f139d8b0c1f"}
Jul 08 09:07:26.304034 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.303984    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dznzv" podStartSLOduration=2.088671966 podStartE2EDuration="22.303964772s" totalImagesPullingTime="20.215292806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:26.303492495 +0000 UTC m=+22.813266238" watchObservedRunningTime="2026-07-08 09:07:26.303964772 +0000 UTC m=+22.813738499"
Jul 08 09:07:26.319754 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.319716    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.ec2.internal" podStartSLOduration=21.319702166 podStartE2EDuration="21.319702166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:26.319411354 +0000 UTC m=+22.829185080" watchObservedRunningTime="2026-07-08 09:07:26.319702166 +0000 UTC m=+22.829475893"
Jul 08 09:07:26.338925 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:26.338882    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wj7vk" podStartSLOduration=1.789303782 podStartE2EDuration="22.3388675s" totalImagesPullingTime="20.549563718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:26.338637198 +0000 UTC m=+22.848410942" watchObservedRunningTime="2026-07-08 09:07:26.3388675 +0000 UTC m=+22.848641223"
Jul 08 09:07:27.028998 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.028819    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:27.029371 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.028834    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:27.029371 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:27.029091    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:27.029371 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:27.029149    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:27.286679 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.286364    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jqnv" event={"ID":"a5b73df2-ed31-43aa-8d3f-65fbbdf67185","Type":"ContainerStarted","Data":"7ec483dc22c690f919c2567042c19a231a9065c63fced6788003aa0aef4da1e3"}
Jul 08 09:07:27.288053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.287952    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj9wl" event={"ID":"71affc53-ce18-464f-b286-5a85131e8173","Type":"ContainerStarted","Data":"b19d7ccd6b7f0f16607107c936866e44e90c6250e444a8526eb267c5fcf77b43"}
Jul 08 09:07:27.289670 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.289639    2547 generic.go:356] "Generic (PLEG): container finished" podID="b003598a660c3ddf5966bb2c7b709083" containerID="92ba96ef802fd2627c10ad9b35a20ec3cb7a0e818335c52bdb6fd05086990cb4" exitCode=0
Jul 08 09:07:27.289810 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.289707    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal" event={"ID":"b003598a660c3ddf5966bb2c7b709083","Type":"ContainerDied","Data":"92ba96ef802fd2627c10ad9b35a20ec3cb7a0e818335c52bdb6fd05086990cb4"}
Jul 08 09:07:27.291374 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.291348    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l" event={"ID":"4ff9417c-ef70-4444-aa63-72d47986ba1c","Type":"ContainerStarted","Data":"51a0de37be4c655d50e4508459355bb849c164e5e714812b5daedde87a8d5c11"}
Jul 08 09:07:27.292922 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.292894    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7jv4" event={"ID":"3923a524-da38-4f1b-820b-c587360b2aa7","Type":"ContainerStarted","Data":"a842dad05f3c6707a4333c2504a6daebbee020d37068a42d8c970ddf3759c161"}
Jul 08 09:07:27.294788 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.294767    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="4b4fcfb09987a5d909add8ab29b738bfbe5a6a609afaae6555e32c79faaeb31b" exitCode=0
Jul 08 09:07:27.294875 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.294837    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"4b4fcfb09987a5d909add8ab29b738bfbe5a6a609afaae6555e32c79faaeb31b"}
Jul 08 09:07:27.296543 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.296517    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z2h8f" event={"ID":"5bd44263-6841-48d6-8b54-5ad791278672","Type":"ContainerStarted","Data":"656df9da492d75a6e20e06aa08883419a584cc937a4d2435636680f789b76fc0"}
Jul 08 09:07:27.299840 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.299823    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:07:27.300211 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.300185    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"f7b976db7e93642b5c9266af8e48e0f723b5fe4920bd0fdd4df3dc10c27c91a2"}
Jul 08 09:07:27.305274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.305224    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9jqnv" podStartSLOduration=3.154808918 podStartE2EDuration="23.305205136s" totalImagesPullingTime="20.150396218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:27.305098291 +0000 UTC m=+23.814872047" watchObservedRunningTime="2026-07-08 09:07:27.305205136 +0000 UTC m=+23.814978865"
Jul 08 09:07:27.361009 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.360757    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b7jv4" podStartSLOduration=3.274888132 podStartE2EDuration="23.360737608s" totalImagesPullingTime="20.085849476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:27.332105149 +0000 UTC m=+23.841878877" watchObservedRunningTime="2026-07-08 09:07:27.360737608 +0000 UTC m=+23.870511337"
Jul 08 09:07:27.382538 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.382445    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z2h8f" podStartSLOduration=3.230169082 podStartE2EDuration="23.382431002s" totalImagesPullingTime="20.15226192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:27.381894288 +0000 UTC m=+23.891668016" watchObservedRunningTime="2026-07-08 09:07:27.382431002 +0000 UTC m=+23.892204728"
Jul 08 09:07:27.425540 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:27.425487    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hj9wl" podStartSLOduration=3.235105401 podStartE2EDuration="23.425448501s" totalImagesPullingTime="20.1903431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:27.424948354 +0000 UTC m=+23.934722093" watchObservedRunningTime="2026-07-08 09:07:27.425448501 +0000 UTC m=+23.935222228"
Jul 08 09:07:28.028448 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.028410    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:28.028645 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:28.028585    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:28.045786 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.045757    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 09:07:28.246429 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.246353    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:28.246870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.246855    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:28.305178 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.305130    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal" event={"ID":"b003598a660c3ddf5966bb2c7b709083","Type":"ContainerStarted","Data":"d09c5287453209155e9eedb1d5db4defce172f9d7ec8d11b2e920b380898ef28"}
Jul 08 09:07:28.307294 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.307264    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l" event={"ID":"4ff9417c-ef70-4444-aa63-72d47986ba1c","Type":"ContainerStarted","Data":"bfe9a3ee47afc35329263973c1e978dd2626dc2e1382ddb4a0fa31b48e82b641"}
Jul 08 09:07:28.934442 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.934339    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T09:07:28.045780011Z","UUID":"6c3e8e4d-3f05-4953-a3c6-12fe50d8381f","Handler":null,"Name":"","Endpoint":""}
Jul 08 09:07:28.936219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.936194    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 09:07:28.936369 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:28.936245    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 09:07:29.028227 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:29.028193    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:29.028417 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:29.028241    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:29.028417 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:29.028334    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:29.028531 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:29.028450    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:29.313081 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:29.313059    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:07:29.313497 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:29.313472    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"6fcb0d839ca9222243b01cd3ab4b1474d8e3589acbd859e2ea94f00cd038386e"}
Jul 08 09:07:29.313553 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:29.313528    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 09:07:30.028220 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:30.028167    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:30.028400 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:30.028318    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:30.318111 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:30.318027    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l" event={"ID":"4ff9417c-ef70-4444-aa63-72d47986ba1c","Type":"ContainerStarted","Data":"d5a7d3150fe1a5299b279731bfe8e994a1fed3fd5f6c3a9e69bef37f98234348"}
Jul 08 09:07:30.340064 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:30.340001    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.ec2.internal" podStartSLOduration=25.339985025 podStartE2EDuration="25.339985025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:28.33166362 +0000 UTC m=+24.841437348" watchObservedRunningTime="2026-07-08 09:07:30.339985025 +0000 UTC m=+26.849758751"
Jul 08 09:07:31.029395 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.029166    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:31.029554 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.029176    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:31.029554 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:31.029444    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:31.029554 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:31.029500    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:31.324928 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.324852    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:07:31.325801 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.325299    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"7fe63fab5972c0cf6363495d0a25eae2a9d4c7cd7a31faa4891b6d0a090fe821"}
Jul 08 09:07:31.325801 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.325639    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:31.325801 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.325714    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:31.325977 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.325864    2547 scope.go:117] "RemoveContainer" containerID="49666a00486825fee96460b460ee3d372f5216caf15648ee921cc3352356a796"
Jul 08 09:07:31.342579 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.342549    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:31.360878 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:31.360828    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgc5l" podStartSLOduration=4.910681124 podStartE2EDuration="27.360811264s" totalImagesPullingTime="22.45013014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:30.340074731 +0000 UTC m=+26.849848458" watchObservedRunningTime="2026-07-08 09:07:31.360811264 +0000 UTC m=+27.870585030"
Jul 08 09:07:32.029319 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.029072    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:32.029535 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:32.029442    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:32.882166 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.882136    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zpnxl"]
Jul 08 09:07:32.882665 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.882320    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:32.882665 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:32.882418    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:32.886612 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.886583    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mzmh8"]
Jul 08 09:07:32.886875 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.886643    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmn8b"]
Jul 08 09:07:32.886875 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.886844    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:32.887015 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:32.886958    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:32.887073 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:32.887030    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:32.887150 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:32.887129    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:33.334557 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.334478    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:07:33.334879 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.334856    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" event={"ID":"7097b115-b2cd-474a-86d2-4b83f0a14cdf","Type":"ContainerStarted","Data":"7df00ee5563cedec61cfa5697190980595e330cf9477da736fb0c8e5e2817a69"}
Jul 08 09:07:33.335054 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.335040    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:33.336755 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.336730    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="ced4374726b82cc4919bfabc12eb06319fd63d6f1f5d5586d32bc7418ef9432b" exitCode=0
Jul 08 09:07:33.336898 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.336764    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"ced4374726b82cc4919bfabc12eb06319fd63d6f1f5d5586d32bc7418ef9432b"}
Jul 08 09:07:33.350742 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.350722    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:07:33.370869 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.370819    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" podStartSLOduration=8.876584535 podStartE2EDuration="29.370803874s" totalImagesPullingTime="20.494219339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:33.37023026 +0000 UTC m=+29.880003987" watchObservedRunningTime="2026-07-08 09:07:33.370803874 +0000 UTC m=+29.880577638"
Jul 08 09:07:33.646216 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.646040    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:33.646411 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.646333    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 09:07:33.646732 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:33.646708    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hj9wl"
Jul 08 09:07:35.028788 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.028686    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:35.028788 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.028774    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:35.029236 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.028854    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:35.029236 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:35.028875    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:35.029236 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:35.028932    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:35.029236 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:35.029021    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:35.343653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.343551    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="79d82b029e5f1c2e29c5e3cbad5186b68360553c3796205d2c5f1288b96e2954" exitCode=0
Jul 08 09:07:35.343653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.343636    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"79d82b029e5f1c2e29c5e3cbad5186b68360553c3796205d2c5f1288b96e2954"}
Jul 08 09:07:35.356605 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:35.356564    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6" podUID="7097b115-b2cd-474a-86d2-4b83f0a14cdf" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 08 09:07:36.632078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:36.631972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:36.632078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:36.632016    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:36.632643 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.632140    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:36.632643 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.632193    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:36.632643 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.632212    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret podName:21f38273-da84-4f9c-84cc-b9c6a2285fdd nodeName:}" failed. No retries permitted until 2026-07-08 09:08:08.63219483 +0000 UTC m=+65.141968539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret") pod "global-pull-secret-syncer-mzmh8" (UID: "21f38273-da84-4f9c-84cc-b9c6a2285fdd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 09:07:36.632643 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.632241    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:08.632229397 +0000 UTC m=+65.142003105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 09:07:36.732433 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:36.732395    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:36.732629 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.732580    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 09:07:36.732629 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.732605    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 09:07:36.732629 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.732616    2547 projected.go:196] Error preparing data for projected volume kube-api-access-cr9t6 for pod openshift-network-diagnostics/network-check-target-zpnxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:36.732723 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:36.732667    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6 podName:cb0300d8-34fb-4c03-8ee7-b63676530968 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:08.732653565 +0000 UTC m=+65.242427274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cr9t6" (UniqueName: "kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6") pod "network-check-target-zpnxl" (UID: "cb0300d8-34fb-4c03-8ee7-b63676530968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 09:07:37.028270 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:37.028235    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:37.028452 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:37.028233    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:37.028452 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:37.028374    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmn8b" podUID="19616da9-862e-494b-b920-5c310a8d7243"
Jul 08 09:07:37.028452 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:37.028240    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:37.028452 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:37.028425    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpnxl" podUID="cb0300d8-34fb-4c03-8ee7-b63676530968"
Jul 08 09:07:37.028675 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:37.028517    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzmh8" podUID="21f38273-da84-4f9c-84cc-b9c6a2285fdd"
Jul 08 09:07:37.350971 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:37.350875    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="fa2f46fe98f8ec69fadda7e5d98847196619e18001e065e047d8aa34185dd46d" exitCode=0
Jul 08 09:07:37.350971 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:37.350928    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"fa2f46fe98f8ec69fadda7e5d98847196619e18001e065e047d8aa34185dd46d"}
Jul 08 09:07:38.668832 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.668803    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-104.ec2.internal" event="NodeReady"
Jul 08 09:07:38.669351 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.668952    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 09:07:38.722820 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.722784    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hlzc6"]
Jul 08 09:07:38.741667 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.741575    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6ssw7"]
Jul 08 09:07:38.741980 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.741955    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.744762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.744738    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 09:07:38.745359 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.745335    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 09:07:38.745512 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.745442    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qglp2\""
Jul 08 09:07:38.765509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.765470    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlzc6"]
Jul 08 09:07:38.765509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.765508    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ssw7"]
Jul 08 09:07:38.765704 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.765589    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.768147 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.768105    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 09:07:38.768272 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.768178    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8jcgn\""
Jul 08 09:07:38.768272 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.768235    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 09:07:38.768517 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.768497    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 09:07:38.847289 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847252    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0046c92-6ac6-495e-818a-e1ceb8ed2456-config-volume\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.847289 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847292    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvrb\" (UniqueName: \"kubernetes.io/projected/f0046c92-6ac6-495e-818a-e1ceb8ed2456-kube-api-access-zpvrb\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.847563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847327    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-cert\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.847563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0046c92-6ac6-495e-818a-e1ceb8ed2456-tmp-dir\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.847563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847525    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62wcb\" (UniqueName: \"kubernetes.io/projected/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-kube-api-access-62wcb\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.847563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.847551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.948255 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948168    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0046c92-6ac6-495e-818a-e1ceb8ed2456-tmp-dir\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.948255 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948244    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62wcb\" (UniqueName: \"kubernetes.io/projected/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-kube-api-access-62wcb\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.948514 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948291    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.948514 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948324    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0046c92-6ac6-495e-818a-e1ceb8ed2456-config-volume\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.948514 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948345    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvrb\" (UniqueName: \"kubernetes.io/projected/f0046c92-6ac6-495e-818a-e1ceb8ed2456-kube-api-access-zpvrb\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.948514 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948376    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-cert\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.948514 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:38.948470    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:38.948766 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:38.948554    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:39.448529071 +0000 UTC m=+35.958302780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:07:38.948766 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.948613    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0046c92-6ac6-495e-818a-e1ceb8ed2456-tmp-dir\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.949054 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.949029    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0046c92-6ac6-495e-818a-e1ceb8ed2456-config-volume\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.953096 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.953062    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-cert\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:38.960025 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.959993    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvrb\" (UniqueName: \"kubernetes.io/projected/f0046c92-6ac6-495e-818a-e1ceb8ed2456-kube-api-access-zpvrb\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:38.961063 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:38.961028    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62wcb\" (UniqueName: \"kubernetes.io/projected/ce5fba4a-b1c3-4ca8-8221-71e4194cc250-kube-api-access-62wcb\") pod \"ingress-canary-6ssw7\" (UID: \"ce5fba4a-b1c3-4ca8-8221-71e4194cc250\") " pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:39.029109 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.029071    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:07:39.029311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.029071    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:07:39.029311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.029072    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:07:39.032551 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.032514    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gctfj\""
Jul 08 09:07:39.032729 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.032622    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 09:07:39.032729 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.032514    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 09:07:39.032845 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.032807    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 09:07:39.032906 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.032849    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 09:07:39.033102 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.033071    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6bnkm\""
Jul 08 09:07:39.076123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.076068    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ssw7"
Jul 08 09:07:39.284911 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.284713    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ssw7"]
Jul 08 09:07:39.288932 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:07:39.288904    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5fba4a_b1c3_4ca8_8221_71e4194cc250.slice/crio-fb2d21e97e72e83002ae38a1fa3de24a83d0498adfc62615cefd8c2adc8bc275 WatchSource:0}: Error finding container fb2d21e97e72e83002ae38a1fa3de24a83d0498adfc62615cefd8c2adc8bc275: Status 404 returned error can't find the container with id fb2d21e97e72e83002ae38a1fa3de24a83d0498adfc62615cefd8c2adc8bc275
Jul 08 09:07:39.357080 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.357039    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ssw7" event={"ID":"ce5fba4a-b1c3-4ca8-8221-71e4194cc250","Type":"ContainerStarted","Data":"fb2d21e97e72e83002ae38a1fa3de24a83d0498adfc62615cefd8c2adc8bc275"}
Jul 08 09:07:39.451783 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:39.451738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:39.451977 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:39.451926    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:39.452035 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:39.452005    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:40.451981929 +0000 UTC m=+36.961755637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:07:40.459669 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:40.459631    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:40.460254 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:40.459808    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:40.460254 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:40.459870    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:42.459856199 +0000 UTC m=+38.969629904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:07:42.367399 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:42.367363    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="c4c7c4bed0173526a23d991ffab73f58188846d84d9d42f4ca6b3d2ef4beb5e5" exitCode=0
Jul 08 09:07:42.367892 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:42.367433    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"c4c7c4bed0173526a23d991ffab73f58188846d84d9d42f4ca6b3d2ef4beb5e5"}
Jul 08 09:07:42.474834 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:42.474804    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:42.474984 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:42.474920    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:42.474984 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:42.474964    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:46.474951874 +0000 UTC m=+42.984725583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:07:43.372908 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:43.372863    2547 generic.go:356] "Generic (PLEG): container finished" podID="734c02dc-c843-4064-80e0-1fa52fc9e9ba" containerID="e1fcc2dcb1eedd8cc59c4f8106f72eb6ddc845f91f25605ee5d4bcb07f625179" exitCode=0
Jul 08 09:07:43.373360 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:43.372925    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerDied","Data":"e1fcc2dcb1eedd8cc59c4f8106f72eb6ddc845f91f25605ee5d4bcb07f625179"}
Jul 08 09:07:44.378213 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:44.378021    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" event={"ID":"734c02dc-c843-4064-80e0-1fa52fc9e9ba","Type":"ContainerStarted","Data":"b7a2167e0bb2cd10bebd9c3a3939f141ad9f8f41bfb68be72016f4b60a9bbfd8"}
Jul 08 09:07:44.379508 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:44.379484    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ssw7" event={"ID":"ce5fba4a-b1c3-4ca8-8221-71e4194cc250","Type":"ContainerStarted","Data":"37dfe79fa171736072ad0040e9010bcf80f939c7f3fc56b4ef10134dd8927521"}
Jul 08 09:07:44.404610 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:44.404562    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6bc4x" podStartSLOduration=8.393596614 podStartE2EDuration="40.404546554s" totalImagesPullingTime="32.01094994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:44.403136435 +0000 UTC m=+40.912910166" watchObservedRunningTime="2026-07-08 09:07:44.404546554 +0000 UTC m=+40.914320280"
Jul 08 09:07:44.421259 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:44.421211    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6ssw7" podStartSLOduration=2.140156439 podStartE2EDuration="6.421195861s" totalImagesPullingTime="4.281039422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:07:44.420604996 +0000 UTC m=+40.930378737" watchObservedRunningTime="2026-07-08 09:07:44.421195861 +0000 UTC m=+40.930969566"
Jul 08 09:07:46.507678 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:46.507639    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:46.508052 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:46.507809    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:46.508052 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:46.507874    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:07:54.507858633 +0000 UTC m=+51.017632342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:07:54.564990 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:07:54.564947    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:07:54.565505 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:54.565116    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:07:54.565505 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:07:54.565187    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:10.565170812 +0000 UTC m=+67.074944519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:08:05.353940 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:05.353912    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwrk6"
Jul 08 09:08:08.661611 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.661562    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:08:08.661611 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.661618    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:08:08.664833 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.664813    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 09:08:08.665632 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.665618    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 09:08:08.671926 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:08.671906    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 09:08:08.671986 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:08.671974    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs podName:19616da9-862e-494b-b920-5c310a8d7243 nodeName:}" failed. No retries permitted until 2026-07-08 09:09:12.671956156 +0000 UTC m=+129.181729860 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs") pod "network-metrics-daemon-dmn8b" (UID: "19616da9-862e-494b-b920-5c310a8d7243") : secret "metrics-daemon-secret" not found
Jul 08 09:08:08.676170 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.676151    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f38273-da84-4f9c-84cc-b9c6a2285fdd-original-pull-secret\") pod \"global-pull-secret-syncer-mzmh8\" (UID: \"21f38273-da84-4f9c-84cc-b9c6a2285fdd\") " pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:08:08.750892 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.750841    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzmh8"
Jul 08 09:08:08.761987 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.761955    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:08:08.765595 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.765566    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 09:08:08.775172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.775152    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 09:08:08.785835 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.785806    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr9t6\" (UniqueName: \"kubernetes.io/projected/cb0300d8-34fb-4c03-8ee7-b63676530968-kube-api-access-cr9t6\") pod \"network-check-target-zpnxl\" (UID: \"cb0300d8-34fb-4c03-8ee7-b63676530968\") " pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:08:08.896036 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:08.896005    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mzmh8"]
Jul 08 09:08:08.899339 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:08.899306    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f38273_da84_4f9c_84cc_b9c6a2285fdd.slice/crio-aac349c049c3929abd880195d65c2b001e1aa7c1509b3ba64934f25b5d91116b WatchSource:0}: Error finding container aac349c049c3929abd880195d65c2b001e1aa7c1509b3ba64934f25b5d91116b: Status 404 returned error can't find the container with id aac349c049c3929abd880195d65c2b001e1aa7c1509b3ba64934f25b5d91116b
Jul 08 09:08:09.059721 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:09.059642    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gctfj\""
Jul 08 09:08:09.067197 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:09.067178    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:08:09.201113 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:09.201085    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zpnxl"]
Jul 08 09:08:09.204446 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:09.204421    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0300d8_34fb_4c03_8ee7_b63676530968.slice/crio-296c754b838dbcf19d2c9145ed0d9055f67e0643a05d01ef97edcc501f290a2e WatchSource:0}: Error finding container 296c754b838dbcf19d2c9145ed0d9055f67e0643a05d01ef97edcc501f290a2e: Status 404 returned error can't find the container with id 296c754b838dbcf19d2c9145ed0d9055f67e0643a05d01ef97edcc501f290a2e
Jul 08 09:08:09.439744 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:09.439704    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mzmh8" event={"ID":"21f38273-da84-4f9c-84cc-b9c6a2285fdd","Type":"ContainerStarted","Data":"aac349c049c3929abd880195d65c2b001e1aa7c1509b3ba64934f25b5d91116b"}
Jul 08 09:08:09.440970 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:09.440943    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zpnxl" event={"ID":"cb0300d8-34fb-4c03-8ee7-b63676530968","Type":"ContainerStarted","Data":"296c754b838dbcf19d2c9145ed0d9055f67e0643a05d01ef97edcc501f290a2e"}
Jul 08 09:08:10.576610 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.576560    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:10.577101 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.576778    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 09:08:10.577101 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.576837    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls podName:f0046c92-6ac6-495e-818a-e1ceb8ed2456 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:42.576822443 +0000 UTC m=+99.086596148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls") pod "dns-default-hlzc6" (UID: "f0046c92-6ac6-495e-818a-e1ceb8ed2456") : secret "dns-default-metrics-tls" not found
Jul 08 09:08:10.827073 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.826639    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"]
Jul 08 09:08:10.828893 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.828861    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"]
Jul 08 09:08:10.829055 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.829005    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"
Jul 08 09:08:10.831131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.831104    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"]
Jul 08 09:08:10.831268 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.831236    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:10.832670 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.832650    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8wh4g\""
Jul 08 09:08:10.833379 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.833356    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.833999 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.833980    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 09:08:10.834272 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.834081    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 09:08:10.834359 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.834334    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:08:10.834412 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.834254    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4nbs2\""
Jul 08 09:08:10.841145 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.840894    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 09:08:10.841894 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.841776    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 09:08:10.841894 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.841815    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s9sgf\""
Jul 08 09:08:10.842395 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.842222    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 09:08:10.842395 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.842256    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nv7hn"]
Jul 08 09:08:10.842395 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.842324    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 09:08:10.844244 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.844219    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"]
Jul 08 09:08:10.844368 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.844350    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.847289 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.847268    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 08 09:08:10.847708 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.847657    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 09:08:10.848912 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.848894    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 08 09:08:10.848988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.848920    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"]
Jul 08 09:08:10.851691 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.851668    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-m4x8w\""
Jul 08 09:08:10.851993 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.851909    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 09:08:10.852600 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.852575    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"]
Jul 08 09:08:10.859055 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.859027    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 08 09:08:10.866820 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.866792    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nv7hn"]
Jul 08 09:08:10.879736 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.879698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5xnp\" (UniqueName: \"kubernetes.io/projected/29f35983-d6b3-4d07-bb6c-9c4811a80317-kube-api-access-h5xnp\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:10.879986 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.879959    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-tmp\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880090 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880040    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04fdc79f-40b7-403c-8b3e-f6488a78161f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.880090 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.880199 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880106    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880250 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880203    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv75n\" (UniqueName: \"kubernetes.io/projected/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-kube-api-access-jv75n\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880364 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880248    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:10.880364 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880276    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-serving-cert\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880364 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlp2f\" (UniqueName: \"kubernetes.io/projected/98ac40ae-6a7c-4a6b-9fec-fcce6423666d-kube-api-access-nlp2f\") pod \"network-check-source-989f8b8dc-j8chf\" (UID: \"98ac40ae-6a7c-4a6b-9fec-fcce6423666d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"
Jul 08 09:08:10.880364 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880361    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-snapshots\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880573 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880397    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.880573 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.880476    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cvm\" (UniqueName: \"kubernetes.io/projected/04fdc79f-40b7-403c-8b3e-f6488a78161f-kube-api-access-24cvm\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.947657 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.947623    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gpkrt"]
Jul 08 09:08:10.950317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.950290    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:10.954758 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.954727    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 09:08:10.954758 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.954727    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 09:08:10.955139 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.955055    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-829l7\""
Jul 08 09:08:10.955517 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.955439    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 09:08:10.955816 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.955774    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:08:10.962310 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.962285    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 09:08:10.972035 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.970375    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gpkrt"]
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981518    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-tmp\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-config\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981622    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-trusted-ca\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981681    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04fdc79f-40b7-403c-8b3e-f6488a78161f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981708    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981735    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981757    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35c77b3-8d9d-4781-8317-b79cc528bc92-serving-cert\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981784    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv75n\" (UniqueName: \"kubernetes.io/projected/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-kube-api-access-jv75n\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981813    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981835    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-serving-cert\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981867    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlp2f\" (UniqueName: \"kubernetes.io/projected/98ac40ae-6a7c-4a6b-9fec-fcce6423666d-kube-api-access-nlp2f\") pod \"network-check-source-989f8b8dc-j8chf\" (UID: \"98ac40ae-6a7c-4a6b-9fec-fcce6423666d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981895    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-snapshots\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981922    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bct\" (UniqueName: \"kubernetes.io/projected/d35c77b3-8d9d-4781-8317-b79cc528bc92-kube-api-access-p4bct\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.981961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.982690 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.982022    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cvm\" (UniqueName: \"kubernetes.io/projected/04fdc79f-40b7-403c-8b3e-f6488a78161f-kube-api-access-24cvm\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.982057    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5xnp\" (UniqueName: \"kubernetes.io/projected/29f35983-d6b3-4d07-bb6c-9c4811a80317-kube-api-access-h5xnp\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.982510    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.982592    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls podName:29f35983-d6b3-4d07-bb6c-9c4811a80317 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:11.482571506 +0000 UTC m=+67.992345215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q4r2b" (UID: "29f35983-d6b3-4d07-bb6c-9c4811a80317") : secret "samples-operator-tls" not found
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.982753    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-tmp\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.982966    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:10.983053    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:11.483033915 +0000 UTC m=+67.992807620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:10.983569 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.983533    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04fdc79f-40b7-403c-8b3e-f6488a78161f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:10.983930 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.983642    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-snapshots\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.983983 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.983944    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.984089 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.983983    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:10.985928 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:10.985907    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-serving-cert\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:11.004229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.004172    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cvm\" (UniqueName: \"kubernetes.io/projected/04fdc79f-40b7-403c-8b3e-f6488a78161f-kube-api-access-24cvm\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:11.005038 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.004783    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlp2f\" (UniqueName: \"kubernetes.io/projected/98ac40ae-6a7c-4a6b-9fec-fcce6423666d-kube-api-access-nlp2f\") pod \"network-check-source-989f8b8dc-j8chf\" (UID: \"98ac40ae-6a7c-4a6b-9fec-fcce6423666d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"
Jul 08 09:08:11.005417 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.005367    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5xnp\" (UniqueName: \"kubernetes.io/projected/29f35983-d6b3-4d07-bb6c-9c4811a80317-kube-api-access-h5xnp\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:11.006692 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.006654    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv75n\" (UniqueName: \"kubernetes.io/projected/6eb3acd7-d580-4802-a1a8-a0859b4e20f5-kube-api-access-jv75n\") pod \"insights-operator-5c847dcfc4-nv7hn\" (UID: \"6eb3acd7-d580-4802-a1a8-a0859b4e20f5\") " pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:11.083100 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.083005    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35c77b3-8d9d-4781-8317-b79cc528bc92-serving-cert\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.083100 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.083078    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bct\" (UniqueName: \"kubernetes.io/projected/d35c77b3-8d9d-4781-8317-b79cc528bc92-kube-api-access-p4bct\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.083331 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.083151    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-config\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.083331 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.083177    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-trusted-ca\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.084078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.084032    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-config\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.084206 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.084158    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35c77b3-8d9d-4781-8317-b79cc528bc92-trusted-ca\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.086506 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.086481    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35c77b3-8d9d-4781-8317-b79cc528bc92-serving-cert\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.092695 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.092667    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bct\" (UniqueName: \"kubernetes.io/projected/d35c77b3-8d9d-4781-8317-b79cc528bc92-kube-api-access-p4bct\") pod \"console-operator-68b757fb67-gpkrt\" (UID: \"d35c77b3-8d9d-4781-8317-b79cc528bc92\") " pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.145482 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.145376    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"
Jul 08 09:08:11.172356 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.172319    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn"
Jul 08 09:08:11.263701 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.263669    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:11.486736 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.486667    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:11.486736 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:11.486741    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:11.486981 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:11.486845    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:11.486981 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:11.486859    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 09:08:11.486981 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:11.486923    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls podName:29f35983-d6b3-4d07-bb6c-9c4811a80317 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:12.486903998 +0000 UTC m=+68.996677704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q4r2b" (UID: "29f35983-d6b3-4d07-bb6c-9c4811a80317") : secret "samples-operator-tls" not found
Jul 08 09:08:11.486981 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:11.486938    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:12.48693067 +0000 UTC m=+68.996704376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:12.495500 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:12.495464    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:12.495965 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:12.495571    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:12.495965 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:12.495633    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 09:08:12.495965 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:12.495701    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:12.495965 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:12.495716    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls podName:29f35983-d6b3-4d07-bb6c-9c4811a80317 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:14.49569393 +0000 UTC m=+71.005467641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q4r2b" (UID: "29f35983-d6b3-4d07-bb6c-9c4811a80317") : secret "samples-operator-tls" not found
Jul 08 09:08:12.495965 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:12.495758    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:14.495740931 +0000 UTC m=+71.005514659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:14.000328 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.000300    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf"]
Jul 08 09:08:14.002696 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:14.002661    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ac40ae_6a7c_4a6b_9fec_fcce6423666d.slice/crio-71cf1eb45d85790234d68158408274fbea6672e2b50b3f8153d9e465f62a2817 WatchSource:0}: Error finding container 71cf1eb45d85790234d68158408274fbea6672e2b50b3f8153d9e465f62a2817: Status 404 returned error can't find the container with id 71cf1eb45d85790234d68158408274fbea6672e2b50b3f8153d9e465f62a2817
Jul 08 09:08:14.016660 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.016631    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gpkrt"]
Jul 08 09:08:14.019296 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:14.019261    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35c77b3_8d9d_4781_8317_b79cc528bc92.slice/crio-e352bc2250a3d48a099db37ce20a8a03eaf3c9f9302c005c4cb69b71c4557eac WatchSource:0}: Error finding container e352bc2250a3d48a099db37ce20a8a03eaf3c9f9302c005c4cb69b71c4557eac: Status 404 returned error can't find the container with id e352bc2250a3d48a099db37ce20a8a03eaf3c9f9302c005c4cb69b71c4557eac
Jul 08 09:08:14.037949 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.037924    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nv7hn"]
Jul 08 09:08:14.040509 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:14.040481    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb3acd7_d580_4802_a1a8_a0859b4e20f5.slice/crio-5fa8ec315ad16f35206ff81160269a493407796413ebc484c836e4e41a5c7f8c WatchSource:0}: Error finding container 5fa8ec315ad16f35206ff81160269a493407796413ebc484c836e4e41a5c7f8c: Status 404 returned error can't find the container with id 5fa8ec315ad16f35206ff81160269a493407796413ebc484c836e4e41a5c7f8c
Jul 08 09:08:14.458807 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.458768    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zpnxl" event={"ID":"cb0300d8-34fb-4c03-8ee7-b63676530968","Type":"ContainerStarted","Data":"8a627534236c034f6d64387f6c819d393d045968da4ec6ee6909aaf52eb134f7"}
Jul 08 09:08:14.459010 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.458857    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:08:14.459914 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.459892    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn" event={"ID":"6eb3acd7-d580-4802-a1a8-a0859b4e20f5","Type":"ContainerStarted","Data":"5fa8ec315ad16f35206ff81160269a493407796413ebc484c836e4e41a5c7f8c"}
Jul 08 09:08:14.460916 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.460890    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" event={"ID":"d35c77b3-8d9d-4781-8317-b79cc528bc92","Type":"ContainerStarted","Data":"e352bc2250a3d48a099db37ce20a8a03eaf3c9f9302c005c4cb69b71c4557eac"}
Jul 08 09:08:14.462298 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.462275    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mzmh8" event={"ID":"21f38273-da84-4f9c-84cc-b9c6a2285fdd","Type":"ContainerStarted","Data":"e73f765eb84e70774232123f2b0cfce62ed382934cad4ad2facde003b3701e04"}
Jul 08 09:08:14.463674 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.463656    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf" event={"ID":"98ac40ae-6a7c-4a6b-9fec-fcce6423666d","Type":"ContainerStarted","Data":"b225a9023ff1d0115e3afeac6dbcd23bc25a77781ca657dad428ecdbcf43eea3"}
Jul 08 09:08:14.463766 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.463684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf" event={"ID":"98ac40ae-6a7c-4a6b-9fec-fcce6423666d","Type":"ContainerStarted","Data":"71cf1eb45d85790234d68158408274fbea6672e2b50b3f8153d9e465f62a2817"}
Jul 08 09:08:14.477197 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.477162    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zpnxl" podStartSLOduration=65.839817089 podStartE2EDuration="1m10.477150794s" totalImagesPullingTime="4.637333705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:14.476671298 +0000 UTC m=+70.986445052" watchObservedRunningTime="2026-07-08 09:08:14.477150794 +0000 UTC m=+70.986924520"
Jul 08 09:08:14.498269 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.498212    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j8chf" podStartSLOduration=4.498190322 podStartE2EDuration="4.498190322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:14.497132072 +0000 UTC m=+71.006905800" watchObservedRunningTime="2026-07-08 09:08:14.498190322 +0000 UTC m=+71.007964049"
Jul 08 09:08:14.511907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.511883    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:14.512059 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.512039    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:14.512183 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:14.512168    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:14.512237 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:14.512220    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:18.512208485 +0000 UTC m=+75.021982193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:14.512299 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:14.512175    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 09:08:14.512349 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:14.512329    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls podName:29f35983-d6b3-4d07-bb6c-9c4811a80317 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:18.512308331 +0000 UTC m=+75.022082055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q4r2b" (UID: "29f35983-d6b3-4d07-bb6c-9c4811a80317") : secret "samples-operator-tls" not found
Jul 08 09:08:14.516180 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:14.516133    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mzmh8" podStartSLOduration=65.565030035 podStartE2EDuration="1m10.516116215s" totalImagesPullingTime="4.95108618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:14.515560861 +0000 UTC m=+71.025334580" watchObservedRunningTime="2026-07-08 09:08:14.516116215 +0000 UTC m=+71.025889946"
Jul 08 09:08:17.474539 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.474501    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn" event={"ID":"6eb3acd7-d580-4802-a1a8-a0859b4e20f5","Type":"ContainerStarted","Data":"a49ce66aa9669ae71d9c031ff15ef34530b65173af45f4a1f637762e1591da52"}
Jul 08 09:08:17.476155 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.476137    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/0.log"
Jul 08 09:08:17.476246 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.476169    2547 generic.go:356] "Generic (PLEG): container finished" podID="d35c77b3-8d9d-4781-8317-b79cc528bc92" containerID="9746e751f67e7d4a5a855e6f2bdd188d918269d91c52ebb73ac88f807ef05262" exitCode=255
Jul 08 09:08:17.476246 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.476219    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" event={"ID":"d35c77b3-8d9d-4781-8317-b79cc528bc92","Type":"ContainerDied","Data":"9746e751f67e7d4a5a855e6f2bdd188d918269d91c52ebb73ac88f807ef05262"}
Jul 08 09:08:17.476410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.476396    2547 scope.go:117] "RemoveContainer" containerID="9746e751f67e7d4a5a855e6f2bdd188d918269d91c52ebb73ac88f807ef05262"
Jul 08 09:08:17.497268 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.496996    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn" podStartSLOduration=4.625892851 podStartE2EDuration="7.496969457s" totalImagesPullingTime="2.871076606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:17.496777858 +0000 UTC m=+74.006551589" watchObservedRunningTime="2026-07-08 09:08:17.496969457 +0000 UTC m=+74.006743184"
Jul 08 09:08:17.790654 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.790569    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p4v4q"]
Jul 08 09:08:17.792701 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.792681    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.795724 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.795708    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 09:08:17.795810 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.795714    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vc9gl\""
Jul 08 09:08:17.795954 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.795941    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 09:08:17.816354 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.816322    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4v4q"]
Jul 08 09:08:17.838653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.838624    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.838803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.838662    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5pzb\" (UniqueName: \"kubernetes.io/projected/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-api-access-b5pzb\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.838803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.838728    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c93af8a-7b72-4203-887e-1a45bd8ae671-data-volume\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.838803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.838775    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c93af8a-7b72-4203-887e-1a45bd8ae671-crio-socket\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.838920 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.838842    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.940619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.940672    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5pzb\" (UniqueName: \"kubernetes.io/projected/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-api-access-b5pzb\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.940720    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c93af8a-7b72-4203-887e-1a45bd8ae671-data-volume\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.940771    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c93af8a-7b72-4203-887e-1a45bd8ae671-crio-socket\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.940829    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:17.940973    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:17.941059    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:18.44103967 +0000 UTC m=+74.950813391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : configmap "kube-rbac-proxy" not found
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:17.941412    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:17.941490    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:18.441452751 +0000 UTC m=+74.951226469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.942066    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c93af8a-7b72-4203-887e-1a45bd8ae671-data-volume\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.943421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.942156    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c93af8a-7b72-4203-887e-1a45bd8ae671-crio-socket\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:17.962631 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:17.962598    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5pzb\" (UniqueName: \"kubernetes.io/projected/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-api-access-b5pzb\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:18.443600 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.443549    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:18.443821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.443637    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:18.443821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.443700    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 09:08:18.443821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.443741    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:18.443821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.443799    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:19.443776136 +0000 UTC m=+75.953549859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : configmap "kube-rbac-proxy" not found
Jul 08 09:08:18.443821 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.443821    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:19.44381198 +0000 UTC m=+75.953585685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:18.481521 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.481496    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/1.log"
Jul 08 09:08:18.481902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.481888    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/0.log"
Jul 08 09:08:18.481944 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.481923    2547 generic.go:356] "Generic (PLEG): container finished" podID="d35c77b3-8d9d-4781-8317-b79cc528bc92" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462" exitCode=255
Jul 08 09:08:18.481999 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.481982    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" event={"ID":"d35c77b3-8d9d-4781-8317-b79cc528bc92","Type":"ContainerDied","Data":"9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"}
Jul 08 09:08:18.483032 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.483016    2547 scope.go:117] "RemoveContainer" containerID="9746e751f67e7d4a5a855e6f2bdd188d918269d91c52ebb73ac88f807ef05262"
Jul 08 09:08:18.483128 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.483113    2547 scope.go:117] "RemoveContainer" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"
Jul 08 09:08:18.483305 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.483287    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gpkrt_openshift-console-operator(d35c77b3-8d9d-4781-8317-b79cc528bc92)\"" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podUID="d35c77b3-8d9d-4781-8317-b79cc528bc92"
Jul 08 09:08:18.544403 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.544367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:18.544721 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:18.544701    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:18.544811 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.544743    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:18.544873 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.544820    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:26.544796761 +0000 UTC m=+83.054570470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:18.544873 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.544842    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 09:08:18.544992 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:18.544909    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls podName:29f35983-d6b3-4d07-bb6c-9c4811a80317 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:26.544891511 +0000 UTC m=+83.054665228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q4r2b" (UID: "29f35983-d6b3-4d07-bb6c-9c4811a80317") : secret "samples-operator-tls" not found
Jul 08 09:08:19.263613 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.263581    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x429t"]
Jul 08 09:08:19.266077 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.266060    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.270214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.270187    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 09:08:19.270321 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.270250    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fszqf\""
Jul 08 09:08:19.270881 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.270866    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 09:08:19.271412 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.271394    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 09:08:19.271580 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.271558    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 09:08:19.283487 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.283466    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x429t"]
Jul 08 09:08:19.350752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.350718    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25dv\" (UniqueName: \"kubernetes.io/projected/9e0dd672-85ea-4912-95f5-60c455ffb575-kube-api-access-w25dv\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.350752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.350757    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-cabundle\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.350973 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.350781    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-key\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.452134 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25dv\" (UniqueName: \"kubernetes.io/projected/9e0dd672-85ea-4912-95f5-60c455ffb575-kube-api-access-w25dv\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.452134 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-cabundle\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.452348 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452193    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-key\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.452348 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452258    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:19.452348 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452330    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:19.452532 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:19.452422    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:19.452532 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:19.452445    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 09:08:19.452532 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:19.452499    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:21.452484662 +0000 UTC m=+77.962258370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:19.452532 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:19.452525    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:21.45250653 +0000 UTC m=+77.962280247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : configmap "kube-rbac-proxy" not found
Jul 08 09:08:19.452907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.452887    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-cabundle\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.454643 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.454622    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e0dd672-85ea-4912-95f5-60c455ffb575-signing-key\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.462405 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.462378    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25dv\" (UniqueName: \"kubernetes.io/projected/9e0dd672-85ea-4912-95f5-60c455ffb575-kube-api-access-w25dv\") pod \"service-ca-758f599c5-x429t\" (UID: \"9e0dd672-85ea-4912-95f5-60c455ffb575\") " pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.486781 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.486752    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/1.log"
Jul 08 09:08:19.487129 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.487103    2547 scope.go:117] "RemoveContainer" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"
Jul 08 09:08:19.487281 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:19.487261    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gpkrt_openshift-console-operator(d35c77b3-8d9d-4781-8317-b79cc528bc92)\"" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podUID="d35c77b3-8d9d-4781-8317-b79cc528bc92"
Jul 08 09:08:19.575260 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.575180    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x429t"
Jul 08 09:08:19.701103 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:19.700931    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x429t"]
Jul 08 09:08:19.705926 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:19.705873    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0dd672_85ea_4912_95f5_60c455ffb575.slice/crio-1d7e3e71d674e922160be8d80385223a054bb9dcdcc027e414ff0481ff28e08f WatchSource:0}: Error finding container 1d7e3e71d674e922160be8d80385223a054bb9dcdcc027e414ff0481ff28e08f: Status 404 returned error can't find the container with id 1d7e3e71d674e922160be8d80385223a054bb9dcdcc027e414ff0481ff28e08f
Jul 08 09:08:20.490559 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:20.490518    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x429t" event={"ID":"9e0dd672-85ea-4912-95f5-60c455ffb575","Type":"ContainerStarted","Data":"1d7e3e71d674e922160be8d80385223a054bb9dcdcc027e414ff0481ff28e08f"}
Jul 08 09:08:20.564071 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:20.564042    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9jqnv_a5b73df2-ed31-43aa-8d3f-65fbbdf67185/dns-node-resolver/0.log"
Jul 08 09:08:21.264892 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.264853    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:21.265078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.264931    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:21.265346 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.265326    2547 scope.go:117] "RemoveContainer" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"
Jul 08 09:08:21.265620 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:21.265596    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gpkrt_openshift-console-operator(d35c77b3-8d9d-4781-8317-b79cc528bc92)\"" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podUID="d35c77b3-8d9d-4781-8317-b79cc528bc92"
Jul 08 09:08:21.466850 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.466813    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:21.467047 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.466889    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:21.467047 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:21.466948    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 09:08:21.467047 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:21.467005    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:21.467047 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:21.467028    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:25.467007792 +0000 UTC m=+81.976781501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : configmap "kube-rbac-proxy" not found
Jul 08 09:08:21.467047 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:21.467046    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:25.467034763 +0000 UTC m=+81.976808468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:21.560152 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:21.560083    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7jv4_3923a524-da38-4f1b-820b-c587360b2aa7/node-ca/0.log"
Jul 08 09:08:22.163752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:22.163723    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ssw7_ce5fba4a-b1c3-4ca8-8221-71e4194cc250/serve-healthcheck-canary/0.log"
Jul 08 09:08:22.496944 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:22.496920    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x429t" event={"ID":"9e0dd672-85ea-4912-95f5-60c455ffb575","Type":"ContainerStarted","Data":"96be08de8eb212db27a932244b3c44542ac214a446bc9d13782430e0d275922e"}
Jul 08 09:08:22.520793 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:22.520736    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-x429t" podStartSLOduration=0.786323045 podStartE2EDuration="3.520719514s" totalImagesPullingTime="2.734396469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:22.519126347 +0000 UTC m=+79.028900076" watchObservedRunningTime="2026-07-08 09:08:22.520719514 +0000 UTC m=+79.030493241"
Jul 08 09:08:25.501887 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:25.501766    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:25.501887 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:25.501830    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:25.502401 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:25.501896    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 09:08:25.502401 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:25.501914    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:25.502401 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:25.501961    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:33.50194909 +0000 UTC m=+90.011722799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : secret "insights-runtime-extractor-tls" not found
Jul 08 09:08:25.502401 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:25.501975    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm podName:8c93af8a-7b72-4203-887e-1a45bd8ae671 nodeName:}" failed. No retries permitted until 2026-07-08 09:08:33.501969086 +0000 UTC m=+90.011742791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4v4q" (UID: "8c93af8a-7b72-4203-887e-1a45bd8ae671") : configmap "kube-rbac-proxy" not found
Jul 08 09:08:26.610844 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:26.610801    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:26.611317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:26.610880    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:26.611317 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:26.611002    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:26.611317 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:26.611101    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls podName:04fdc79f-40b7-403c-8b3e-f6488a78161f nodeName:}" failed. No retries permitted until 2026-07-08 09:08:42.611078714 +0000 UTC m=+99.120852439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2tvh6" (UID: "04fdc79f-40b7-403c-8b3e-f6488a78161f") : secret "cluster-monitoring-operator-tls" not found
Jul 08 09:08:26.613188 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:26.613157    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/29f35983-d6b3-4d07-bb6c-9c4811a80317-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q4r2b\" (UID: \"29f35983-d6b3-4d07-bb6c-9c4811a80317\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:26.755177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:26.755147    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"
Jul 08 09:08:26.883292 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:26.883218    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b"]
Jul 08 09:08:27.513417 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:27.513378    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b" event={"ID":"29f35983-d6b3-4d07-bb6c-9c4811a80317","Type":"ContainerStarted","Data":"e68135e62ee20a802aa31aa96f8306f64187d2733cf28e743b05d0ef1e682d7f"}
Jul 08 09:08:29.523518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:29.523484    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b" event={"ID":"29f35983-d6b3-4d07-bb6c-9c4811a80317","Type":"ContainerStarted","Data":"66b285a6d0a90cf7c0b9eca278902dd17841fd9e6f0aa800e2ff37daa0d1644a"}
Jul 08 09:08:29.523900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:29.523541    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b" event={"ID":"29f35983-d6b3-4d07-bb6c-9c4811a80317","Type":"ContainerStarted","Data":"a9051814de50d64b88eaac2f059240104408e8028084c7ab0e75b9dc9e956de2"}
Jul 08 09:08:29.555219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:29.555145    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q4r2b" podStartSLOduration=17.537208953 podStartE2EDuration="19.555122493s" totalImagesPullingTime="2.01791354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:29.553211576 +0000 UTC m=+86.062985321" watchObservedRunningTime="2026-07-08 09:08:29.555122493 +0000 UTC m=+86.064896221"
Jul 08 09:08:32.028808 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.028780    2547 scope.go:117] "RemoveContainer" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"
Jul 08 09:08:32.534917 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.534891    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:08:32.535323 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.535305    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/1.log"
Jul 08 09:08:32.535407 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.535341    2547 generic.go:356] "Generic (PLEG): container finished" podID="d35c77b3-8d9d-4781-8317-b79cc528bc92" containerID="fa01c1540abe4cec436eb1650a0dba750c1dc7c13123c2370b35a945f1cde888" exitCode=255
Jul 08 09:08:32.535407 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.535393    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" event={"ID":"d35c77b3-8d9d-4781-8317-b79cc528bc92","Type":"ContainerDied","Data":"fa01c1540abe4cec436eb1650a0dba750c1dc7c13123c2370b35a945f1cde888"}
Jul 08 09:08:32.535484 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.535441    2547 scope.go:117] "RemoveContainer" containerID="9d635fdd0ff1c675fa6878713f60380eefaff1cbcb8a5d8feba898500bf64462"
Jul 08 09:08:32.535832 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:32.535787    2547 scope.go:117] "RemoveContainer" containerID="fa01c1540abe4cec436eb1650a0dba750c1dc7c13123c2370b35a945f1cde888"
Jul 08 09:08:32.535998 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:32.535974    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-gpkrt_openshift-console-operator(d35c77b3-8d9d-4781-8317-b79cc528bc92)\"" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podUID="d35c77b3-8d9d-4781-8317-b79cc528bc92"
Jul 08 09:08:33.539587 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.539561    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:08:33.567277 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.567252    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:33.567394 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.567299    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:33.567753 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.567736    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c93af8a-7b72-4203-887e-1a45bd8ae671-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:33.569538 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.569522    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c93af8a-7b72-4203-887e-1a45bd8ae671-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4v4q\" (UID: \"8c93af8a-7b72-4203-887e-1a45bd8ae671\") " pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:33.701399 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.701372    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4v4q"
Jul 08 09:08:33.831021 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:33.830943    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4v4q"]
Jul 08 09:08:33.834553 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:33.834525    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c93af8a_7b72_4203_887e_1a45bd8ae671.slice/crio-ec5c8c56bf10dee262f65ed9ec6905d1f9e0f9a281718ddd4ae9e6b75ce7c5ea WatchSource:0}: Error finding container ec5c8c56bf10dee262f65ed9ec6905d1f9e0f9a281718ddd4ae9e6b75ce7c5ea: Status 404 returned error can't find the container with id ec5c8c56bf10dee262f65ed9ec6905d1f9e0f9a281718ddd4ae9e6b75ce7c5ea
Jul 08 09:08:34.549933 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:34.549895    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4v4q" event={"ID":"8c93af8a-7b72-4203-887e-1a45bd8ae671","Type":"ContainerStarted","Data":"ec5c8c56bf10dee262f65ed9ec6905d1f9e0f9a281718ddd4ae9e6b75ce7c5ea"}
Jul 08 09:08:38.565759 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:38.565723    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4v4q" event={"ID":"8c93af8a-7b72-4203-887e-1a45bd8ae671","Type":"ContainerStarted","Data":"5d409915a12020144aa0f3fcedd92d5e93b458712b3109708b322ac6a6f52f47"}
Jul 08 09:08:38.566129 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:38.565785    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4v4q" event={"ID":"8c93af8a-7b72-4203-887e-1a45bd8ae671","Type":"ContainerStarted","Data":"230e4f3abc0687d88877385b08a799765d9d551ec8a53d872a074cd98b733eff"}
Jul 08 09:08:41.264866 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:41.264829    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:41.265219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:41.264884    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:41.265219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:41.265204    2547 scope.go:117] "RemoveContainer" containerID="fa01c1540abe4cec436eb1650a0dba750c1dc7c13123c2370b35a945f1cde888"
Jul 08 09:08:41.265371 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:41.265349    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-gpkrt_openshift-console-operator(d35c77b3-8d9d-4781-8317-b79cc528bc92)\"" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podUID="d35c77b3-8d9d-4781-8317-b79cc528bc92"
Jul 08 09:08:41.577373 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:41.577282    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4v4q" event={"ID":"8c93af8a-7b72-4203-887e-1a45bd8ae671","Type":"ContainerStarted","Data":"d280271e392306260549a6d4b9efc91025c36d61a511c5d4bab6ea996517b89d"}
Jul 08 09:08:41.599292 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:41.599245    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p4v4q" podStartSLOduration=17.779512798 podStartE2EDuration="24.599230196s" totalImagesPullingTime="6.819717398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:08:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:41.598147259 +0000 UTC m=+98.107920987" watchObservedRunningTime="2026-07-08 09:08:41.599230196 +0000 UTC m=+98.109003960"
Jul 08 09:08:42.647817 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.647780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:42.648192 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.647933    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:42.650023 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.649998    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0046c92-6ac6-495e-818a-e1ceb8ed2456-metrics-tls\") pod \"dns-default-hlzc6\" (UID: \"f0046c92-6ac6-495e-818a-e1ceb8ed2456\") " pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:42.650172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.650153    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04fdc79f-40b7-403c-8b3e-f6488a78161f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2tvh6\" (UID: \"04fdc79f-40b7-403c-8b3e-f6488a78161f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:42.656097 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.656076    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qglp2\""
Jul 08 09:08:42.663370 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.663355    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:42.664559 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.664540    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"
Jul 08 09:08:42.828057 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.827893    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlzc6"]
Jul 08 09:08:42.830522 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:42.830494    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0046c92_6ac6_495e_818a_e1ceb8ed2456.slice/crio-41487daac954ab2c8ea5b00d091206efe3380b1b6bb9ed28d8573736a159093d WatchSource:0}: Error finding container 41487daac954ab2c8ea5b00d091206efe3380b1b6bb9ed28d8573736a159093d: Status 404 returned error can't find the container with id 41487daac954ab2c8ea5b00d091206efe3380b1b6bb9ed28d8573736a159093d
Jul 08 09:08:42.846108 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:42.846085    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6"]
Jul 08 09:08:42.848768 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:42.848741    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04fdc79f_40b7_403c_8b3e_f6488a78161f.slice/crio-45934a9369cfc7d8929ccc6b000105a41b477751bed157f8a9c7f65762c50936 WatchSource:0}: Error finding container 45934a9369cfc7d8929ccc6b000105a41b477751bed157f8a9c7f65762c50936: Status 404 returned error can't find the container with id 45934a9369cfc7d8929ccc6b000105a41b477751bed157f8a9c7f65762c50936
Jul 08 09:08:43.423944 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.423914    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"]
Jul 08 09:08:43.434736 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.434713    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"]
Jul 08 09:08:43.434874 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.434838    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.437984 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.437946    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 09:08:43.439380 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.439240    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 09:08:43.439380 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.439271    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 09:08:43.439582 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.439387    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 09:08:43.445875 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.445230    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.446537 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.446506    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"]
Jul 08 09:08:43.447769 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.447726    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"]
Jul 08 09:08:43.449473 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.449310    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wjtrz\""
Jul 08 09:08:43.449590 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.449475    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 09:08:43.553931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.553896    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx95w\" (UniqueName: \"kubernetes.io/projected/ece2df11-2f1d-480e-8eed-2b0b73e64db4-kube-api-access-dx95w\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.554104 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.553942    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b85796f-60c6-40d2-b666-60d70ad84808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.554104 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.553973    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece2df11-2f1d-480e-8eed-2b0b73e64db4-tmp\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.554104 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.553995    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ece2df11-2f1d-480e-8eed-2b0b73e64db4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.554104 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.554092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5krzq\" (UniqueName: \"kubernetes.io/projected/8b85796f-60c6-40d2-b666-60d70ad84808-kube-api-access-5krzq\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.585310 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.585276    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6" event={"ID":"04fdc79f-40b7-403c-8b3e-f6488a78161f","Type":"ContainerStarted","Data":"45934a9369cfc7d8929ccc6b000105a41b477751bed157f8a9c7f65762c50936"}
Jul 08 09:08:43.586511 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.586482    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlzc6" event={"ID":"f0046c92-6ac6-495e-818a-e1ceb8ed2456","Type":"ContainerStarted","Data":"41487daac954ab2c8ea5b00d091206efe3380b1b6bb9ed28d8573736a159093d"}
Jul 08 09:08:43.655266 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655192    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5krzq\" (UniqueName: \"kubernetes.io/projected/8b85796f-60c6-40d2-b666-60d70ad84808-kube-api-access-5krzq\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.655266 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655264    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx95w\" (UniqueName: \"kubernetes.io/projected/ece2df11-2f1d-480e-8eed-2b0b73e64db4-kube-api-access-dx95w\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.655803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655296    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b85796f-60c6-40d2-b666-60d70ad84808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.655803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655329    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece2df11-2f1d-480e-8eed-2b0b73e64db4-tmp\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.655803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ece2df11-2f1d-480e-8eed-2b0b73e64db4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.655964 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.655815    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece2df11-2f1d-480e-8eed-2b0b73e64db4-tmp\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.658332 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.658296    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ece2df11-2f1d-480e-8eed-2b0b73e64db4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.658448 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.658399    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b85796f-60c6-40d2-b666-60d70ad84808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.677381 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.677328    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5krzq\" (UniqueName: \"kubernetes.io/projected/8b85796f-60c6-40d2-b666-60d70ad84808-kube-api-access-5krzq\") pod \"managed-serviceaccount-addon-agent-77c7c869c6-hv24h\" (UID: \"8b85796f-60c6-40d2-b666-60d70ad84808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.677929 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.677905    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx95w\" (UniqueName: \"kubernetes.io/projected/ece2df11-2f1d-480e-8eed-2b0b73e64db4-kube-api-access-dx95w\") pod \"klusterlet-addon-workmgr-6cc964b6d7-56pzf\" (UID: \"ece2df11-2f1d-480e-8eed-2b0b73e64db4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.746631 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.746596    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:43.769980 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.769849    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"
Jul 08 09:08:43.942727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.942653    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h"]
Jul 08 09:08:43.946342 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:43.946277    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b85796f_60c6_40d2_b666_60d70ad84808.slice/crio-c27a16c286b4aae8204b5073f4251bf2fe5b33663e96a0a459af78c53d6841ea WatchSource:0}: Error finding container c27a16c286b4aae8204b5073f4251bf2fe5b33663e96a0a459af78c53d6841ea: Status 404 returned error can't find the container with id c27a16c286b4aae8204b5073f4251bf2fe5b33663e96a0a459af78c53d6841ea
Jul 08 09:08:43.959337 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:43.959318    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"]
Jul 08 09:08:43.962141 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:43.962117    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece2df11_2f1d_480e_8eed_2b0b73e64db4.slice/crio-d3968c0cce877ba717512ea5caf7da429d3cdc3de79854bc6427fc42974fa781 WatchSource:0}: Error finding container d3968c0cce877ba717512ea5caf7da429d3cdc3de79854bc6427fc42974fa781: Status 404 returned error can't find the container with id d3968c0cce877ba717512ea5caf7da429d3cdc3de79854bc6427fc42974fa781
Jul 08 09:08:44.591339 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:44.591294    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h" event={"ID":"8b85796f-60c6-40d2-b666-60d70ad84808","Type":"ContainerStarted","Data":"c27a16c286b4aae8204b5073f4251bf2fe5b33663e96a0a459af78c53d6841ea"}
Jul 08 09:08:44.592716 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:44.592685    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf" event={"ID":"ece2df11-2f1d-480e-8eed-2b0b73e64db4","Type":"ContainerStarted","Data":"d3968c0cce877ba717512ea5caf7da429d3cdc3de79854bc6427fc42974fa781"}
Jul 08 09:08:45.469822 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:45.469795    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zpnxl"
Jul 08 09:08:46.300508 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.296242    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"]
Jul 08 09:08:46.300508 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.299603    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:46.303078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.302709    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m7mkh\""
Jul 08 09:08:46.303078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.302922    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 09:08:46.311250 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.311218    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"]
Jul 08 09:08:46.378135 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.378097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/341e3f40-b8ff-489d-b48d-2b1d666c5907-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nnsql\" (UID: \"341e3f40-b8ff-489d-b48d-2b1d666c5907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:46.478783 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.478738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/341e3f40-b8ff-489d-b48d-2b1d666c5907-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nnsql\" (UID: \"341e3f40-b8ff-489d-b48d-2b1d666c5907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:46.483818 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.483759    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/341e3f40-b8ff-489d-b48d-2b1d666c5907-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nnsql\" (UID: \"341e3f40-b8ff-489d-b48d-2b1d666c5907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:46.605687 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.605161    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6" event={"ID":"04fdc79f-40b7-403c-8b3e-f6488a78161f","Type":"ContainerStarted","Data":"d4653f9b961e0ffee13ec3bd236d63d784c57f5f0574e5341c959b0ddf3d79b8"}
Jul 08 09:08:46.609144 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.609088    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlzc6" event={"ID":"f0046c92-6ac6-495e-818a-e1ceb8ed2456","Type":"ContainerStarted","Data":"9b4966d9ac7a16b6071e65a43375b050dbfc93d900fcde38f6e2caa3283bf654"}
Jul 08 09:08:46.609144 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.609139    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlzc6" event={"ID":"f0046c92-6ac6-495e-818a-e1ceb8ed2456","Type":"ContainerStarted","Data":"c02f7cca537d00d45a992bb33d7dda3a61ddd7939a6b9806e25c75f7035347a9"}
Jul 08 09:08:46.609382 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.609211    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:46.615190 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.614975    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:46.653754 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.653693    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hlzc6" podStartSLOduration=65.840607756 podStartE2EDuration="1m8.653671765s" totalImagesPullingTime="2.813064009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:46.651714559 +0000 UTC m=+103.161488304" watchObservedRunningTime="2026-07-08 09:08:46.653671765 +0000 UTC m=+103.163445488"
Jul 08 09:08:46.653907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.653818    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2tvh6" podStartSLOduration=33.85353516 podStartE2EDuration="36.653811365s" totalImagesPullingTime="2.800276205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:46.63281836 +0000 UTC m=+103.142592098" watchObservedRunningTime="2026-07-08 09:08:46.653811365 +0000 UTC m=+103.163585093"
Jul 08 09:08:46.786597 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:46.786508    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"]
Jul 08 09:08:47.615826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:47.615785    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql" event={"ID":"341e3f40-b8ff-489d-b48d-2b1d666c5907","Type":"ContainerStarted","Data":"8f48afe41e6b48873795d31228bb36d2992e8ec4eac30d8809f1126aa6058ff5"}
Jul 08 09:08:49.627915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.627874    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql" event={"ID":"341e3f40-b8ff-489d-b48d-2b1d666c5907","Type":"ContainerStarted","Data":"5b40d1917cfbd272eeb22ecbdbcb7c2672557b672e64eeaefae3ce36bb731e87"}
Jul 08 09:08:49.628377 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.628050    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:49.630219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.630189    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h" event={"ID":"8b85796f-60c6-40d2-b666-60d70ad84808","Type":"ContainerStarted","Data":"92686d39f3602f02271a1b84fa349d7da8304f93f26dbea925ebb41c95f66341"}
Jul 08 09:08:49.631873 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.631846    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf" event={"ID":"ece2df11-2f1d-480e-8eed-2b0b73e64db4","Type":"ContainerStarted","Data":"68e3e60a388266ae0d24d28365edf7490e7fd175f5b80eb040b15893b9791979"}
Jul 08 09:08:49.632012 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.631995    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:49.633644 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.633623    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql"
Jul 08 09:08:49.633754 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.633683    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf"
Jul 08 09:08:49.645553 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.645452    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nnsql" podStartSLOduration=1.033069885 podStartE2EDuration="3.64543968s" totalImagesPullingTime="2.612369795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:49.644537832 +0000 UTC m=+106.154311564" watchObservedRunningTime="2026-07-08 09:08:49.64543968 +0000 UTC m=+106.155213385"
Jul 08 09:08:49.682423 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.682382    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc964b6d7-56pzf" podStartSLOduration=1.243355329 podStartE2EDuration="6.682368511s" totalImagesPullingTime="5.439013182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:49.664627134 +0000 UTC m=+106.174400879" watchObservedRunningTime="2026-07-08 09:08:49.682368511 +0000 UTC m=+106.192142237"
Jul 08 09:08:49.683005 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:49.682970    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7c869c6-hv24h" podStartSLOduration=1.229419782 podStartE2EDuration="6.682961656s" totalImagesPullingTime="5.453541874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:49.681983945 +0000 UTC m=+106.191757691" watchObservedRunningTime="2026-07-08 09:08:49.682961656 +0000 UTC m=+106.192735392"
Jul 08 09:08:53.028397 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.028366    2547 scope.go:117] "RemoveContainer" containerID="fa01c1540abe4cec436eb1650a0dba750c1dc7c13123c2370b35a945f1cde888"
Jul 08 09:08:53.647096 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.647063    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:08:53.647238 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.647160    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" event={"ID":"d35c77b3-8d9d-4781-8317-b79cc528bc92","Type":"ContainerStarted","Data":"33474be2f0d2a5b1d8e724d1d24a01f1cbcd3dcaf6a73796531f55fd0ed4072f"}
Jul 08 09:08:53.647507 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.647489    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:53.668766 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.668715    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt" podStartSLOduration=40.777361226 podStartE2EDuration="43.668697724s" totalImagesPullingTime="2.891336498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:53.667568775 +0000 UTC m=+110.177342525" watchObservedRunningTime="2026-07-08 09:08:53.668697724 +0000 UTC m=+110.178471453"
Jul 08 09:08:53.673125 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.673104    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-gpkrt"
Jul 08 09:08:53.870352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.870317    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-8tfts"]
Jul 08 09:08:53.872547 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.872525    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:08:53.877398 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.877370    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 09:08:53.877525 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.877424    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 09:08:53.877715 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.877687    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4gzqx\""
Jul 08 09:08:53.886512 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:53.886488    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8tfts"]
Jul 08 09:08:54.036781 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.036712    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgld\" (UniqueName: \"kubernetes.io/projected/050467ca-09aa-4aa3-a469-54381e83f5f6-kube-api-access-2sgld\") pod \"downloads-685bfb5f64-8tfts\" (UID: \"050467ca-09aa-4aa3-a469-54381e83f5f6\") " pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:08:54.137156 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.137121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgld\" (UniqueName: \"kubernetes.io/projected/050467ca-09aa-4aa3-a469-54381e83f5f6-kube-api-access-2sgld\") pod \"downloads-685bfb5f64-8tfts\" (UID: \"050467ca-09aa-4aa3-a469-54381e83f5f6\") " pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:08:54.147777 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.147749    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgld\" (UniqueName: \"kubernetes.io/projected/050467ca-09aa-4aa3-a469-54381e83f5f6-kube-api-access-2sgld\") pod \"downloads-685bfb5f64-8tfts\" (UID: \"050467ca-09aa-4aa3-a469-54381e83f5f6\") " pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:08:54.181716 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.181679    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:08:54.308060 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.307983    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8tfts"]
Jul 08 09:08:54.311472 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:54.311348    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050467ca_09aa_4aa3_a469_54381e83f5f6.slice/crio-48031ad7c7ecc752988edf71cdfbca6d1fe06659184ce6f47557783a46afc071 WatchSource:0}: Error finding container 48031ad7c7ecc752988edf71cdfbca6d1fe06659184ce6f47557783a46afc071: Status 404 returned error can't find the container with id 48031ad7c7ecc752988edf71cdfbca6d1fe06659184ce6f47557783a46afc071
Jul 08 09:08:54.651256 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.651220    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8tfts" event={"ID":"050467ca-09aa-4aa3-a469-54381e83f5f6","Type":"ContainerStarted","Data":"48031ad7c7ecc752988edf71cdfbca6d1fe06659184ce6f47557783a46afc071"}
Jul 08 09:08:54.920639 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.920561    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hkjph"]
Jul 08 09:08:54.923685 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.923662    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:54.927880 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.927857    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 09:08:54.928129 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.928113    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 09:08:54.928226 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.928208    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 09:08:54.928288 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.928244    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tzxvj\""
Jul 08 09:08:54.929123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:54.929105    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 09:08:55.045089 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045054    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-wtmp\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-sys\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045191    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-root\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045240    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfptv\" (UniqueName: \"kubernetes.io/projected/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-kube-api-access-qfptv\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045330    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-tls\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045378    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045447    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-textfile\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.045509 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.045489    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-metrics-client-ca\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146608 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146569    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-tls\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146647    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146675    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-textfile\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146693    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-metrics-client-ca\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146719    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146762 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146757    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-wtmp\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146794    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-sys\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146815    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-root\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146836    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfptv\" (UniqueName: \"kubernetes.io/projected/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-kube-api-access-qfptv\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.146997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.146935    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-sys\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.147188 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.147074    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-wtmp\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.147188 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.147112    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-textfile\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.147188 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.147121    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-root\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.147413 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.147380    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.147535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.147380    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-metrics-client-ca\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.149091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.149073    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.149365 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.149350    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-node-exporter-tls\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.161136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.161110    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfptv\" (UniqueName: \"kubernetes.io/projected/714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95-kube-api-access-qfptv\") pod \"node-exporter-hkjph\" (UID: \"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95\") " pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.235250 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.235182    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkjph"
Jul 08 09:08:55.245039 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:55.245010    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714a3e2e_7a11_46ee_ad0e_9f33ab0f9a95.slice/crio-8049bbb9425360e2afdf7d3e074df2915b1a1205bebeed687d2c0d6130c83ae9 WatchSource:0}: Error finding container 8049bbb9425360e2afdf7d3e074df2915b1a1205bebeed687d2c0d6130c83ae9: Status 404 returned error can't find the container with id 8049bbb9425360e2afdf7d3e074df2915b1a1205bebeed687d2c0d6130c83ae9
Jul 08 09:08:55.655587 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:55.655554    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkjph" event={"ID":"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95","Type":"ContainerStarted","Data":"8049bbb9425360e2afdf7d3e074df2915b1a1205bebeed687d2c0d6130c83ae9"}
Jul 08 09:08:56.619400 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:56.619361    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hlzc6"
Jul 08 09:08:57.664097 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.664059    2547 generic.go:356] "Generic (PLEG): container finished" podID="714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95" containerID="65812c20779e3d5dfc22b5dc9649502a5c64475f7bb567ad597deda4e6343854" exitCode=0
Jul 08 09:08:57.664847 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.664120    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkjph" event={"ID":"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95","Type":"ContainerDied","Data":"65812c20779e3d5dfc22b5dc9649502a5c64475f7bb567ad597deda4e6343854"}
Jul 08 09:08:57.921357 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.921277    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6548d977-fwbbd"]
Jul 08 09:08:57.924331 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.924306    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:57.931037 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.930955    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 09:08:57.931037 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.930979    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 09:08:57.931037 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.931007    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-54j9vkqc4pi91\""
Jul 08 09:08:57.931486 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.931103    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 09:08:57.931486 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.930955    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 09:08:57.931486 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.930956    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 09:08:57.931486 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.931278    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m8vgt\""
Jul 08 09:08:57.941657 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:57.941580    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6548d977-fwbbd"]
Jul 08 09:08:58.074028 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.073993    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074034    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-grpc-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074104    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074147    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbr47\" (UniqueName: \"kubernetes.io/projected/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-kube-api-access-tbr47\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074194    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-metrics-client-ca\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074375 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074243    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074375 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074273    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.074375 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.074298    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175586    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175628    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-grpc-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175673 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175672    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175774    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbr47\" (UniqueName: \"kubernetes.io/projected/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-kube-api-access-tbr47\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175814    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-metrics-client-ca\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175865    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175898    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.175941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.175926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.177126 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.177059    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-metrics-client-ca\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.180496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.180472    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.180825 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.180775    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.180936 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.180915    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.181438 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.181394    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.182049 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.182011    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-grpc-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.182602 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.182576    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-secret-thanos-querier-tls\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.185242 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.185221    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbr47\" (UniqueName: \"kubernetes.io/projected/72913a0a-0b01-4523-b7c8-04ce1ebd71c5-kube-api-access-tbr47\") pod \"thanos-querier-6548d977-fwbbd\" (UID: \"72913a0a-0b01-4523-b7c8-04ce1ebd71c5\") " pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.237779 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.237753    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:08:58.408534 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:08:58.405168    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72913a0a_0b01_4523_b7c8_04ce1ebd71c5.slice/crio-cc4c9fdcf79f158b05e9e97ffd5afbf360ced33897ac4506e02cf872925e71af WatchSource:0}: Error finding container cc4c9fdcf79f158b05e9e97ffd5afbf360ced33897ac4506e02cf872925e71af: Status 404 returned error can't find the container with id cc4c9fdcf79f158b05e9e97ffd5afbf360ced33897ac4506e02cf872925e71af
Jul 08 09:08:58.408534 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.407362    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6548d977-fwbbd"]
Jul 08 09:08:58.668997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.668956    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"cc4c9fdcf79f158b05e9e97ffd5afbf360ced33897ac4506e02cf872925e71af"}
Jul 08 09:08:58.671181 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.671154    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkjph" event={"ID":"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95","Type":"ContainerStarted","Data":"be23405668d660988fcbb6a31fe5d5112c37cbb5e9ad06f67eea249e381fa886"}
Jul 08 09:08:58.671317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.671200    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkjph" event={"ID":"714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95","Type":"ContainerStarted","Data":"db9259e9a4cd07bace0756e60b791ba19327e875387fd8b1276237a098b6d878"}
Jul 08 09:08:58.696757 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:58.696705    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hkjph" podStartSLOduration=3.21571494 podStartE2EDuration="4.696685463s" totalImagesPullingTime="1.405500741s" totalInitContainerRuntime="75.469782ms" isStatefulPod=true podCreationTimestamp="2026-07-08 09:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:08:58.696200806 +0000 UTC m=+115.205974534" watchObservedRunningTime="2026-07-08 09:08:58.696685463 +0000 UTC m=+115.206459191"
Jul 08 09:08:59.523756 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.523721    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"]
Jul 08 09:08:59.527518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.527296    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:08:59.530199 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.530077    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fkt4k\""
Jul 08 09:08:59.530199 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.530129    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 09:08:59.537517 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.536741    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"]
Jul 08 09:08:59.690610 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.690571    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:08:59.691067 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.690621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbvf\" (UniqueName: \"kubernetes.io/projected/508f60fb-a780-4065-a0ae-cc134016086c-kube-api-access-hzbvf\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:08:59.792084 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.791998    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:08:59.792084 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.792064    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbvf\" (UniqueName: \"kubernetes.io/projected/508f60fb-a780-4065-a0ae-cc134016086c-kube-api-access-hzbvf\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:08:59.792801 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:59.792770    2547 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 09:08:59.792939 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:08:59.792865    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert podName:508f60fb-a780-4065-a0ae-cc134016086c nodeName:}" failed. No retries permitted until 2026-07-08 09:09:00.292840836 +0000 UTC m=+116.802614542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-rcmbv" (UID: "508f60fb-a780-4065-a0ae-cc134016086c") : secret "monitoring-plugin-cert" not found
Jul 08 09:08:59.803266 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:08:59.803182    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbvf\" (UniqueName: \"kubernetes.io/projected/508f60fb-a780-4065-a0ae-cc134016086c-kube-api-access-hzbvf\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:00.297307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:00.297214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:00.300317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:00.300286    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/508f60fb-a780-4065-a0ae-cc134016086c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rcmbv\" (UID: \"508f60fb-a780-4065-a0ae-cc134016086c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:00.440873 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:00.440838    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:00.801284 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:00.801261    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"]
Jul 08 09:09:00.804741 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:09:00.804697    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508f60fb_a780_4065_a0ae_cc134016086c.slice/crio-ad0420066c8aa5bec098864b724a0bd924795380db66d2e4daef6dc6085701ad WatchSource:0}: Error finding container ad0420066c8aa5bec098864b724a0bd924795380db66d2e4daef6dc6085701ad: Status 404 returned error can't find the container with id ad0420066c8aa5bec098864b724a0bd924795380db66d2e4daef6dc6085701ad
Jul 08 09:09:01.687989 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.687946    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv" event={"ID":"508f60fb-a780-4065-a0ae-cc134016086c","Type":"ContainerStarted","Data":"ad0420066c8aa5bec098864b724a0bd924795380db66d2e4daef6dc6085701ad"}
Jul 08 09:09:01.690753 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.690724    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"e84864d10f69fa92369eb5c53458da3db804748342c006c4578a3ee7d89039de"}
Jul 08 09:09:01.690888 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.690800    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"271b3b1489cd111b9e851919b32190169af8cfb8653b6ee426e46233aa10692d"}
Jul 08 09:09:01.690888 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.690841    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"74b829a1a083f35196a31bfe001a108eda298580f974ff931082ef860aad8229"}
Jul 08 09:09:01.797536 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.797493    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:01.801020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.800971    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.803872 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.803834    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7z6k\""
Jul 08 09:09:01.804296 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.804074    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 09:09:01.805355 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.805111    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 09:09:01.805355 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.805298    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 09:09:01.805553 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.805367    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 09:09:01.805553 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.805382    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812020    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812073    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7x7n\" (UniqueName: \"kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812118    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812172    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812205    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.812307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.812232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.816482 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.814088    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:01.914015 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.913960    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7x7n\" (UniqueName: \"kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.914177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.914025    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.914177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.914078    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.914177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.914110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.914177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.914133    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.914177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.914169    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.915085 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.915022    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.915085 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.915065    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.915590 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.915563    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.917432 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.917305    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.917593 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.917482    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:01.924636 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:01.924605    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7x7n\" (UniqueName: \"kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n\") pod \"console-5df8866fbb-xfwbv\" (UID: \"57433d22-949e-4596-b750-72134037821b\") " pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:02.112896 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.112813    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:02.405400 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.405378    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:02.409039 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:09:02.409010    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57433d22_949e_4596_b750_72134037821b.slice/crio-b62948edc0b9c0afe94af59abe622d62da23e5d835899e20ff871d2583c0fde9 WatchSource:0}: Error finding container b62948edc0b9c0afe94af59abe622d62da23e5d835899e20ff871d2583c0fde9: Status 404 returned error can't find the container with id b62948edc0b9c0afe94af59abe622d62da23e5d835899e20ff871d2583c0fde9
Jul 08 09:09:02.697040 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.697000    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv" event={"ID":"508f60fb-a780-4065-a0ae-cc134016086c","Type":"ContainerStarted","Data":"ace71fd36a213275b3b8db8302725cc1a44f522d3f9e4f0f6a95d9f50a95a0a8"}
Jul 08 09:09:02.697247 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.697069    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:02.698666 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.698640    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8866fbb-xfwbv" event={"ID":"57433d22-949e-4596-b750-72134037821b","Type":"ContainerStarted","Data":"b62948edc0b9c0afe94af59abe622d62da23e5d835899e20ff871d2583c0fde9"}
Jul 08 09:09:02.702386 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.702359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"fa0648d348020c36f2f7372f57504aa2bd6aade6e7a940469e8025afb2b35705"}
Jul 08 09:09:02.702524 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.702427    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"f95429f7e64a9f00a46285cee81b2815be10167d7ff707424f6ce532730dddee"}
Jul 08 09:09:02.702524 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.702484    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" event={"ID":"72913a0a-0b01-4523-b7c8-04ce1ebd71c5","Type":"ContainerStarted","Data":"ace2b8f88ad2528157f4b5fecc8be709f40093880287761dcc5241858e3c321d"}
Jul 08 09:09:02.702654 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.702584    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:09:02.703539 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.703517    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv"
Jul 08 09:09:02.720495 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.720417    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rcmbv" podStartSLOduration=2.2947058240000002 podStartE2EDuration="3.720392437s" totalImagesPullingTime="1.425686613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:09:02.72002765 +0000 UTC m=+119.229801381" watchObservedRunningTime="2026-07-08 09:09:02.720392437 +0000 UTC m=+119.230166165"
Jul 08 09:09:02.746436 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:02.746360    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd" podStartSLOduration=2.172053135 podStartE2EDuration="5.746339169s" totalImagesPullingTime="3.574286034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:09:02.745282022 +0000 UTC m=+119.255055752" watchObservedRunningTime="2026-07-08 09:09:02.746339169 +0000 UTC m=+119.256112897"
Jul 08 09:09:06.729331 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:06.729274    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8866fbb-xfwbv" event={"ID":"57433d22-949e-4596-b750-72134037821b","Type":"ContainerStarted","Data":"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"}
Jul 08 09:09:06.750073 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:06.750012    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5df8866fbb-xfwbv" podStartSLOduration=2.309904582 podStartE2EDuration="5.749989811s" totalImagesPullingTime="3.440085229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:09:06.747950321 +0000 UTC m=+123.257724049" watchObservedRunningTime="2026-07-08 09:09:06.749989811 +0000 UTC m=+123.259763542"
Jul 08 09:09:08.715393 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:08.715362    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6548d977-fwbbd"
Jul 08 09:09:12.113038 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.113001    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:12.113435 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.113075    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:12.118131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.118108    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:12.717634 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.717601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:09:12.720184 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.720149    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19616da9-862e-494b-b920-5c310a8d7243-metrics-certs\") pod \"network-metrics-daemon-dmn8b\" (UID: \"19616da9-862e-494b-b920-5c310a8d7243\") " pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:09:12.757702 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.757675    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:12.945834 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.945792    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6bnkm\""
Jul 08 09:09:12.953379 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:12.953354    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmn8b"
Jul 08 09:09:13.297370 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.297331    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmn8b"]
Jul 08 09:09:13.440207 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:09:13.440179    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19616da9_862e_494b_b920_5c310a8d7243.slice/crio-e59474f313779946ece4cd335bd748c29af9d4aaa883dfd92c05e0c0fdec3857 WatchSource:0}: Error finding container e59474f313779946ece4cd335bd748c29af9d4aaa883dfd92c05e0c0fdec3857: Status 404 returned error can't find the container with id e59474f313779946ece4cd335bd748c29af9d4aaa883dfd92c05e0c0fdec3857
Jul 08 09:09:13.759767 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.759592    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8tfts" event={"ID":"050467ca-09aa-4aa3-a469-54381e83f5f6","Type":"ContainerStarted","Data":"28e93d261ecbdb1a0a57f7aab33cdb6dea1a1be36a05d6ad06497459b12695c6"}
Jul 08 09:09:13.759914 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.759768    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:09:13.761159 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.761130    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmn8b" event={"ID":"19616da9-862e-494b-b920-5c310a8d7243","Type":"ContainerStarted","Data":"e59474f313779946ece4cd335bd748c29af9d4aaa883dfd92c05e0c0fdec3857"}
Jul 08 09:09:13.769814 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.769793    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-8tfts"
Jul 08 09:09:13.813760 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:13.813701    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-8tfts" podStartSLOduration=1.627651367 podStartE2EDuration="20.813681175s" totalImagesPullingTime="19.186029808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:09:13.783345973 +0000 UTC m=+130.293119702" watchObservedRunningTime="2026-07-08 09:09:13.813681175 +0000 UTC m=+130.323454907"
Jul 08 09:09:15.775874 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:15.775791    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmn8b" event={"ID":"19616da9-862e-494b-b920-5c310a8d7243","Type":"ContainerStarted","Data":"4f6f8342f6c09a8e57a18245cb0b6b7938de6db70758b200c2834a6c60308fb1"}
Jul 08 09:09:15.775874 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:15.775859    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmn8b" event={"ID":"19616da9-862e-494b-b920-5c310a8d7243","Type":"ContainerStarted","Data":"bb728a926097350fcafe8026cdac96d246afba44859e35504fb277eb4e90e602"}
Jul 08 09:09:19.925475 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:19.925399    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dmn8b" podStartSLOduration=134.21269559 podStartE2EDuration="2m15.925383112s" totalImagesPullingTime="1.712687522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:09:15.806971308 +0000 UTC m=+132.316745059" watchObservedRunningTime="2026-07-08 09:09:19.925383112 +0000 UTC m=+136.435156838"
Jul 08 09:09:19.926368 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:19.926350    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:22.807263 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:22.807228    2547 generic.go:356] "Generic (PLEG): container finished" podID="6eb3acd7-d580-4802-a1a8-a0859b4e20f5" containerID="a49ce66aa9669ae71d9c031ff15ef34530b65173af45f4a1f637762e1591da52" exitCode=0
Jul 08 09:09:22.807644 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:22.807304    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn" event={"ID":"6eb3acd7-d580-4802-a1a8-a0859b4e20f5","Type":"ContainerDied","Data":"a49ce66aa9669ae71d9c031ff15ef34530b65173af45f4a1f637762e1591da52"}
Jul 08 09:09:22.807686 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:22.807668    2547 scope.go:117] "RemoveContainer" containerID="a49ce66aa9669ae71d9c031ff15ef34530b65173af45f4a1f637762e1591da52"
Jul 08 09:09:23.813343 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:23.813306    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nv7hn" event={"ID":"6eb3acd7-d580-4802-a1a8-a0859b4e20f5","Type":"ContainerStarted","Data":"13a2cb6bc351239382a3ae74c26a8f2e240b9adef1b83cc2115077b990711b27"}
Jul 08 09:09:44.950554 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:44.950475    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5df8866fbb-xfwbv" podUID="57433d22-949e-4596-b750-72134037821b" containerName="console" containerID="cri-o://bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986" gracePeriod=15
Jul 08 09:09:45.234183 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.234110    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:45.294741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294709    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.294900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294754    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7x7n\" (UniqueName: \"kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.294900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294783    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.294900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294820    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.294900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294869    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.295102 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.294918    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert\") pod \"57433d22-949e-4596-b750-72134037821b\" (UID: \"57433d22-949e-4596-b750-72134037821b\") "
Jul 08 09:09:45.295195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.295159    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:09:45.295289 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.295254    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config" (OuterVolumeSpecName: "console-config") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:09:45.295407 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.295313    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca" (OuterVolumeSpecName: "service-ca") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:09:45.297035 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.297007    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:09:45.297117 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.297047    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:09:45.297117 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.297057    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n" (OuterVolumeSpecName: "kube-api-access-j7x7n") pod "57433d22-949e-4596-b750-72134037821b" (UID: "57433d22-949e-4596-b750-72134037821b"). InnerVolumeSpecName "kube-api-access-j7x7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:09:45.395680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395649    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-oauth-config\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.395680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395675    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57433d22-949e-4596-b750-72134037821b-console-serving-cert\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.395680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395684    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-oauth-serving-cert\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.395886 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395693    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7x7n\" (UniqueName: \"kubernetes.io/projected/57433d22-949e-4596-b750-72134037821b-kube-api-access-j7x7n\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.395886 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395703    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-console-config\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.395886 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.395711    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57433d22-949e-4596-b750-72134037821b-service-ca\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:09:45.894974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.894932    2547 generic.go:356] "Generic (PLEG): container finished" podID="57433d22-949e-4596-b750-72134037821b" containerID="bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986" exitCode=0
Jul 08 09:09:45.895137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.894983    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df8866fbb-xfwbv"
Jul 08 09:09:45.895137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.894998    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8866fbb-xfwbv" event={"ID":"57433d22-949e-4596-b750-72134037821b","Type":"ContainerDied","Data":"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"}
Jul 08 09:09:45.895137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.895070    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df8866fbb-xfwbv" event={"ID":"57433d22-949e-4596-b750-72134037821b","Type":"ContainerDied","Data":"b62948edc0b9c0afe94af59abe622d62da23e5d835899e20ff871d2583c0fde9"}
Jul 08 09:09:45.895137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.895093    2547 scope.go:117] "RemoveContainer" containerID="bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"
Jul 08 09:09:45.904801 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.904783    2547 scope.go:117] "RemoveContainer" containerID="bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"
Jul 08 09:09:45.905076 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:09:45.905052    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986\": container with ID starting with bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986 not found: ID does not exist" containerID="bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"
Jul 08 09:09:45.905149 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.905088    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986"} err="failed to get container status \"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986\": rpc error: code = NotFound desc = could not find container \"bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986\": container with ID starting with bf738728dce7bbc9f7055c716d459cf82da9205548a133023647e0c65ed8f986 not found: ID does not exist"
Jul 08 09:09:45.920526 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.920498    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:45.924999 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:45.924971    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5df8866fbb-xfwbv"]
Jul 08 09:09:46.033639 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:09:46.033609    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57433d22-949e-4596-b750-72134037821b" path="/var/lib/kubelet/pods/57433d22-949e-4596-b750-72134037821b/volumes"
Jul 08 09:11:53.888009 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.887971    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:11:53.888427 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.888287    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57433d22-949e-4596-b750-72134037821b" containerName="console"
Jul 08 09:11:53.888427 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.888303    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="57433d22-949e-4596-b750-72134037821b" containerName="console"
Jul 08 09:11:53.888427 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.888366    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="57433d22-949e-4596-b750-72134037821b" containerName="console"
Jul 08 09:11:53.890530 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.890511    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.895478 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895432    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 09:11:53.895691 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895448    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 09:11:53.895691 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895684    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 09:11:53.895829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895472    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7z6k\""
Jul 08 09:11:53.895829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895615    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 09:11:53.895956 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.895449    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 09:11:53.900252 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.900232    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 09:11:53.915081 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.915052    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:11:53.949563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949532    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68whm\" (UniqueName: \"kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949580    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949606    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949705    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949741 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949736    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949874 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949752    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:53.949874 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:53.949777    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.050951 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.050921    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.050951 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.050955    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051203 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.050972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051203 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.050991    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051203 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051020    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68whm\" (UniqueName: \"kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051203 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051065    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051203 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051854 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051827    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051983 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.051983 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.051888    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.052099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.052030    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.053493 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.053447    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.053578 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.053552    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.062228 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.062209    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68whm\" (UniqueName: \"kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm\") pod \"console-cd4d98647-k4pjs\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") " pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.201508 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.201443    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:11:54.346425 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.346391    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:11:54.350734 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:11:54.350701    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e4d531_9785_4e2b_aa1a_4d08791da159.slice/crio-405a865a68c7182f66e79b758b0f4ba9ae1f2489018b3f901eaafbcded5e95c0 WatchSource:0}: Error finding container 405a865a68c7182f66e79b758b0f4ba9ae1f2489018b3f901eaafbcded5e95c0: Status 404 returned error can't find the container with id 405a865a68c7182f66e79b758b0f4ba9ae1f2489018b3f901eaafbcded5e95c0
Jul 08 09:11:54.368680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:54.368648    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd4d98647-k4pjs" event={"ID":"59e4d531-9785-4e2b-aa1a-4d08791da159","Type":"ContainerStarted","Data":"405a865a68c7182f66e79b758b0f4ba9ae1f2489018b3f901eaafbcded5e95c0"}
Jul 08 09:11:55.373859 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:11:55.373821    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd4d98647-k4pjs" event={"ID":"59e4d531-9785-4e2b-aa1a-4d08791da159","Type":"ContainerStarted","Data":"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"}
Jul 08 09:12:03.868119 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:03.868087    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:12:03.872511 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:03.872490    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:12:03.874931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:03.874910    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:12:03.878985 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:03.878959    2547 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 09:12:03.879974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:03.879956    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:12:04.202659 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:04.202626    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:12:04.203804 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:04.202689    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:12:04.207406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:04.207387    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:12:04.228672 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:04.228627    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd4d98647-k4pjs" podStartSLOduration=11.228611418 podStartE2EDuration="11.228611418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:11:55.397755906 +0000 UTC m=+291.907529652" watchObservedRunningTime="2026-07-08 09:12:04.228611418 +0000 UTC m=+300.738385144"
Jul 08 09:12:04.413296 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:12:04.413271    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:13:01.763073 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.763003    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"]
Jul 08 09:13:01.765148 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.765132    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.768979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.768952    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 09:13:01.769106 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.768979    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:13:01.769106 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.768995    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tr7bf\""
Jul 08 09:13:01.789642 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.789615    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"]
Jul 08 09:13:01.880208 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.880179    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqrb\" (UniqueName: \"kubernetes.io/projected/a2e70135-ec14-4cd5-80a7-60d31618f8b6-kube-api-access-wmqrb\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.880334 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.880249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e70135-ec14-4cd5-80a7-60d31618f8b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.981451 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.981421    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e70135-ec14-4cd5-80a7-60d31618f8b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.981583 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.981495    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqrb\" (UniqueName: \"kubernetes.io/projected/a2e70135-ec14-4cd5-80a7-60d31618f8b6-kube-api-access-wmqrb\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.981774 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.981754    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e70135-ec14-4cd5-80a7-60d31618f8b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:01.994324 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:01.994298    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqrb\" (UniqueName: \"kubernetes.io/projected/a2e70135-ec14-4cd5-80a7-60d31618f8b6-kube-api-access-wmqrb\") pod \"cert-manager-operator-controller-manager-55c444bf86-4sm4q\" (UID: \"a2e70135-ec14-4cd5-80a7-60d31618f8b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:02.074831 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:02.074774    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"
Jul 08 09:13:02.214170 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:02.214141    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q"]
Jul 08 09:13:02.217428 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:02.217401    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e70135_ec14_4cd5_80a7_60d31618f8b6.slice/crio-4f16427a258ba83acd3b2f3c03b3d510ec63a90a2993d7ec271a008a0aff0313 WatchSource:0}: Error finding container 4f16427a258ba83acd3b2f3c03b3d510ec63a90a2993d7ec271a008a0aff0313: Status 404 returned error can't find the container with id 4f16427a258ba83acd3b2f3c03b3d510ec63a90a2993d7ec271a008a0aff0313
Jul 08 09:13:02.220158 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:02.220138    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 09:13:02.632420 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:02.632387    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q" event={"ID":"a2e70135-ec14-4cd5-80a7-60d31618f8b6","Type":"ContainerStarted","Data":"4f16427a258ba83acd3b2f3c03b3d510ec63a90a2993d7ec271a008a0aff0313"}
Jul 08 09:13:05.649913 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:05.649851    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q" event={"ID":"a2e70135-ec14-4cd5-80a7-60d31618f8b6","Type":"ContainerStarted","Data":"f0af5db9d73301276a391aa2bf1b915cdca5ef285a8480139da8dd890f99b793"}
Jul 08 09:13:05.689655 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:05.689596    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4sm4q" podStartSLOduration=1.979425262 podStartE2EDuration="4.689579569s" totalImagesPullingTime="2.710154307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:13:05.6871316 +0000 UTC m=+362.196905341" watchObservedRunningTime="2026-07-08 09:13:05.689579569 +0000 UTC m=+362.199353297"
Jul 08 09:13:08.729412 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.729380    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"]
Jul 08 09:13:08.734578 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.734546    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.739716 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.739692    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 09:13:08.739832 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.739783    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 09:13:08.741229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.741207    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zkspf\""
Jul 08 09:13:08.755622 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.755595    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"]
Jul 08 09:13:08.836215 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.836185    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.836350 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.836223    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqzfx\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-kube-api-access-wqzfx\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.937007 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.936976    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.937141 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.937015    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqzfx\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-kube-api-access-wqzfx\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.947217 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.947188    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:08.947903 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:08.947886    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqzfx\" (UniqueName: \"kubernetes.io/projected/afe834e0-3892-47d8-b31b-20f71f842944-kube-api-access-wqzfx\") pod \"cert-manager-cainjector-559cdd8c87-lq56v\" (UID: \"afe834e0-3892-47d8-b31b-20f71f842944\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:09.043862 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:09.043810    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"
Jul 08 09:13:09.201048 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:09.200985    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lq56v"]
Jul 08 09:13:09.203288 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:09.203260    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafe834e0_3892_47d8_b31b_20f71f842944.slice/crio-e45765265621d62905ccef5650078b696a26c4f9135c8882afe90cf75783ac16 WatchSource:0}: Error finding container e45765265621d62905ccef5650078b696a26c4f9135c8882afe90cf75783ac16: Status 404 returned error can't find the container with id e45765265621d62905ccef5650078b696a26c4f9135c8882afe90cf75783ac16
Jul 08 09:13:09.667031 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:09.667001    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v" event={"ID":"afe834e0-3892-47d8-b31b-20f71f842944","Type":"ContainerStarted","Data":"e45765265621d62905ccef5650078b696a26c4f9135c8882afe90cf75783ac16"}
Jul 08 09:13:12.682432 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:12.682392    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v" event={"ID":"afe834e0-3892-47d8-b31b-20f71f842944","Type":"ContainerStarted","Data":"a8213818be05def09865d428b209f9b51b19629f3947071d29f21152032f658f"}
Jul 08 09:13:12.708272 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:12.708227    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lq56v" podStartSLOduration=1.8302634819999999 podStartE2EDuration="4.708211656s" totalImagesPullingTime="2.877948174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:13:12.706647844 +0000 UTC m=+369.216421590" watchObservedRunningTime="2026-07-08 09:13:12.708211656 +0000 UTC m=+369.217985382"
Jul 08 09:13:18.593107 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.593077    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mx4jb"]
Jul 08 09:13:18.595442 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.595427    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.598513 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.598495    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6lbpd\""
Jul 08 09:13:18.605267 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.605247    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mx4jb"]
Jul 08 09:13:18.720636 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.720606    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.720636 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.720637    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxsw\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-kube-api-access-bmxsw\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.821416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.821393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.821542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.821421    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxsw\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-kube-api-access-bmxsw\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.831524 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.831497    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.831617 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.831598    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxsw\" (UniqueName: \"kubernetes.io/projected/bd7ee26b-d99a-494c-a738-4cc7928441f7-kube-api-access-bmxsw\") pod \"cert-manager-55b4d954d5-mx4jb\" (UID: \"bd7ee26b-d99a-494c-a738-4cc7928441f7\") " pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:18.904560 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:18.904540    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mx4jb"
Jul 08 09:13:19.048085 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:19.048040    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mx4jb"]
Jul 08 09:13:19.050645 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:19.050612    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd7ee26b_d99a_494c_a738_4cc7928441f7.slice/crio-1fdcb4ef5ed92dd6add7b9da0cc23de558400d973eec210650f0cf79a0f65350 WatchSource:0}: Error finding container 1fdcb4ef5ed92dd6add7b9da0cc23de558400d973eec210650f0cf79a0f65350: Status 404 returned error can't find the container with id 1fdcb4ef5ed92dd6add7b9da0cc23de558400d973eec210650f0cf79a0f65350
Jul 08 09:13:19.713902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:19.713867    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mx4jb" event={"ID":"bd7ee26b-d99a-494c-a738-4cc7928441f7","Type":"ContainerStarted","Data":"232287ef964e67308c4fd68ac7646855d322e001da3b7509eb779deedc333219"}
Jul 08 09:13:19.713902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:19.713908    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mx4jb" event={"ID":"bd7ee26b-d99a-494c-a738-4cc7928441f7","Type":"ContainerStarted","Data":"1fdcb4ef5ed92dd6add7b9da0cc23de558400d973eec210650f0cf79a0f65350"}
Jul 08 09:13:19.754995 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:19.754950    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mx4jb" podStartSLOduration=1.75493415 podStartE2EDuration="1.75493415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:13:19.754762292 +0000 UTC m=+376.264536037" watchObservedRunningTime="2026-07-08 09:13:19.75493415 +0000 UTC m=+376.264707877"
Jul 08 09:13:37.796815 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.796783    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"]
Jul 08 09:13:37.800787 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.800772    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:37.812183 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.812167    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j975l\""
Jul 08 09:13:37.813183 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.813169    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 09:13:37.813496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.813482    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 09:13:37.821937 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.821917    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 09:13:37.822050 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.821953    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 09:13:37.849279 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.849256    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"]
Jul 08 09:13:37.968187 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.968153    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:37.968352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.968193    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-tmp\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:37.968352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.968309    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-manifests\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:37.968352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.968342    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drrsg\" (UniqueName: \"kubernetes.io/projected/d1e220c6-773f-4b14-bd99-a9607a8b21c5-kube-api-access-drrsg\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:37.968491 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:37.968366    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.069633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.069564    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-manifests\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.069633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.069594    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drrsg\" (UniqueName: \"kubernetes.io/projected/d1e220c6-773f-4b14-bd99-a9607a8b21c5-kube-api-access-drrsg\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.069633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.069615    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.069831 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.069650    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.069831 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.069669    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-tmp\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.070025 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.070004    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-manifests\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.071943 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.071911    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e220c6-773f-4b14-bd99-a9607a8b21c5-tmp\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.072078 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.071994    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.072141 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.072087    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e220c6-773f-4b14-bd99-a9607a8b21c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.094158 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.094134    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drrsg\" (UniqueName: \"kubernetes.io/projected/d1e220c6-773f-4b14-bd99-a9607a8b21c5-kube-api-access-drrsg\") pod \"opendatahub-operator-controller-manager-66d6485f98-vnm6p\" (UID: \"d1e220c6-773f-4b14-bd99-a9607a8b21c5\") " pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.111370 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.111349    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:38.305753 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.305731    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"]
Jul 08 09:13:38.307406 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:38.307384    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e220c6_773f_4b14_bd99_a9607a8b21c5.slice/crio-99951af0d7bbeb2a6069d00b68b88f428ccc706b78d8e06d06bb9567e4805f31 WatchSource:0}: Error finding container 99951af0d7bbeb2a6069d00b68b88f428ccc706b78d8e06d06bb9567e4805f31: Status 404 returned error can't find the container with id 99951af0d7bbeb2a6069d00b68b88f428ccc706b78d8e06d06bb9567e4805f31
Jul 08 09:13:38.793535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:38.793502    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p" event={"ID":"d1e220c6-773f-4b14-bd99-a9607a8b21c5","Type":"ContainerStarted","Data":"99951af0d7bbeb2a6069d00b68b88f428ccc706b78d8e06d06bb9567e4805f31"}
Jul 08 09:13:41.810603 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:41.810492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p" event={"ID":"d1e220c6-773f-4b14-bd99-a9607a8b21c5","Type":"ContainerStarted","Data":"f7c293ccc0bf0e8893a0108dc659be4bd47944812e7b5f462bc2e7a1d745cf3b"}
Jul 08 09:13:42.816867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:42.816831    2547 generic.go:356] "Generic (PLEG): container finished" podID="d1e220c6-773f-4b14-bd99-a9607a8b21c5" containerID="f7c293ccc0bf0e8893a0108dc659be4bd47944812e7b5f462bc2e7a1d745cf3b" exitCode=0
Jul 08 09:13:42.817249 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:42.816888    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p" event={"ID":"d1e220c6-773f-4b14-bd99-a9607a8b21c5","Type":"ContainerDied","Data":"f7c293ccc0bf0e8893a0108dc659be4bd47944812e7b5f462bc2e7a1d745cf3b"}
Jul 08 09:13:43.822876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:43.822845    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p" event={"ID":"d1e220c6-773f-4b14-bd99-a9607a8b21c5","Type":"ContainerStarted","Data":"ac31700f0e0186ee08c4ba2c523866ba2f0624f7220f948f906f2b37a86c3d34"}
Jul 08 09:13:43.823235 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:43.822929    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:43.940049 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:43.939991    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p" podStartSLOduration=2.195279981 podStartE2EDuration="6.939970881s" totalImagesPullingTime="3.65484842s" totalInitContainerRuntime="1.08984248s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:13:43.938554303 +0000 UTC m=+400.448328031" watchObservedRunningTime="2026-07-08 09:13:43.939970881 +0000 UTC m=+400.449744610"
Jul 08 09:13:54.828952 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:54.828920    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66d6485f98-vnm6p"
Jul 08 09:13:57.723900 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.723861    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"]
Jul 08 09:13:57.726421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.726399    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.730945 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.730921    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 09:13:57.731086 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.731068    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 09:13:57.732055 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.732036    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 09:13:57.732055 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.732053    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 09:13:57.732306 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.732293    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vdj5w\""
Jul 08 09:13:57.732351 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.732320    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 09:13:57.756983 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.756948    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"]
Jul 08 09:13:57.817228 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.817190    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.817228 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.817232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81d62574-7fae-4de0-9404-686b51f9ae0a-manager-config\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.817487 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.817271    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-metrics-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.817487 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.817348    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59r7n\" (UniqueName: \"kubernetes.io/projected/81d62574-7fae-4de0-9404-686b51f9ae0a-kube-api-access-59r7n\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.918727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.918694    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.918727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.918728    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81d62574-7fae-4de0-9404-686b51f9ae0a-manager-config\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.918972 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.918754    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-metrics-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.918972 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.918808    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59r7n\" (UniqueName: \"kubernetes.io/projected/81d62574-7fae-4de0-9404-686b51f9ae0a-kube-api-access-59r7n\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.919441 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.919413    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81d62574-7fae-4de0-9404-686b51f9ae0a-manager-config\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.921263 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.921245    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-metrics-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.921422 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.921402    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d62574-7fae-4de0-9404-686b51f9ae0a-cert\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:57.953822 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:57.953790    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59r7n\" (UniqueName: \"kubernetes.io/projected/81d62574-7fae-4de0-9404-686b51f9ae0a-kube-api-access-59r7n\") pod \"lws-controller-manager-6d9788fbb6-9mdcd\" (UID: \"81d62574-7fae-4de0-9404-686b51f9ae0a\") " pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:58.036684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.036609    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:13:58.220708 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.220682    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"]
Jul 08 09:13:58.222598 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:58.222548    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d62574_7fae_4de0_9404_686b51f9ae0a.slice/crio-5df6b7ed89d3a9edb325b68a030c66fc604a602e73d861d78626cc3c11b75175 WatchSource:0}: Error finding container 5df6b7ed89d3a9edb325b68a030c66fc604a602e73d861d78626cc3c11b75175: Status 404 returned error can't find the container with id 5df6b7ed89d3a9edb325b68a030c66fc604a602e73d861d78626cc3c11b75175
Jul 08 09:13:58.390887 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.390856    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"]
Jul 08 09:13:58.394103 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.394084    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.398531 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.398507    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 09:13:58.398927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.398909    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 09:13:58.399210 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.399195    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 09:13:58.399290 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.399240    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dqh28\""
Jul 08 09:13:58.399442 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.399428    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 09:13:58.414884 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.414859    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"]
Jul 08 09:13:58.422726 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.422704    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tls-certs\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.422825 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.422736    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tmp\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.422825 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.422757    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxq2l\" (UniqueName: \"kubernetes.io/projected/5a44171d-4e52-43ed-ab93-33d1a6c66a25-kube-api-access-bxq2l\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.523826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.523794    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tls-certs\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.523826 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.523829    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tmp\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.524024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.523848    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxq2l\" (UniqueName: \"kubernetes.io/projected/5a44171d-4e52-43ed-ab93-33d1a6c66a25-kube-api-access-bxq2l\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.526012 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.525987    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tmp\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.526214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.526196    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a44171d-4e52-43ed-ab93-33d1a6c66a25-tls-certs\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.533654 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.533637    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxq2l\" (UniqueName: \"kubernetes.io/projected/5a44171d-4e52-43ed-ab93-33d1a6c66a25-kube-api-access-bxq2l\") pod \"kube-auth-proxy-5458fdb769-wfz7k\" (UID: \"5a44171d-4e52-43ed-ab93-33d1a6c66a25\") " pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.704155 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.704074    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"
Jul 08 09:13:58.850641 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.850605    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k"]
Jul 08 09:13:58.860748 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:13:58.860724    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a44171d_4e52_43ed_ab93_33d1a6c66a25.slice/crio-137828c40cca9d4c32c70d0b76739d9be551499cc1b7e9ee57b5d46843776f9a WatchSource:0}: Error finding container 137828c40cca9d4c32c70d0b76739d9be551499cc1b7e9ee57b5d46843776f9a: Status 404 returned error can't find the container with id 137828c40cca9d4c32c70d0b76739d9be551499cc1b7e9ee57b5d46843776f9a
Jul 08 09:13:58.887716 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.887682    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd" event={"ID":"81d62574-7fae-4de0-9404-686b51f9ae0a","Type":"ContainerStarted","Data":"5df6b7ed89d3a9edb325b68a030c66fc604a602e73d861d78626cc3c11b75175"}
Jul 08 09:13:58.888794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:13:58.888772    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k" event={"ID":"5a44171d-4e52-43ed-ab93-33d1a6c66a25","Type":"ContainerStarted","Data":"137828c40cca9d4c32c70d0b76739d9be551499cc1b7e9ee57b5d46843776f9a"}
Jul 08 09:14:00.902601 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:00.902550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd" event={"ID":"81d62574-7fae-4de0-9404-686b51f9ae0a","Type":"ContainerStarted","Data":"694c7ec54eb4c2acafc99ed2769e9dc20f11286dd73492db113c8cb26217656f"}
Jul 08 09:14:00.902962 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:00.902689    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:14:00.928645 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:00.928598    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd" podStartSLOduration=1.52394469 podStartE2EDuration="3.928583759s" totalImagesPullingTime="2.404639069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:14:00.927379515 +0000 UTC m=+417.437153266" watchObservedRunningTime="2026-07-08 09:14:00.928583759 +0000 UTC m=+417.438357528"
Jul 08 09:14:02.912698 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:02.912661    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k" event={"ID":"5a44171d-4e52-43ed-ab93-33d1a6c66a25","Type":"ContainerStarted","Data":"b95247627ace96acd6f84cf2b3e656b2f340a83731120b7f708962bab5a9ae5b"}
Jul 08 09:14:02.930546 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:02.930480    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5458fdb769-wfz7k" podStartSLOduration=0.998819199 podStartE2EDuration="4.930446245s" totalImagesPullingTime="3.931627046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:14:02.929530918 +0000 UTC m=+419.439304645" watchObservedRunningTime="2026-07-08 09:14:02.930446245 +0000 UTC m=+419.440219972"
Jul 08 09:14:11.909172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:14:11.909144    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9788fbb6-9mdcd"
Jul 08 09:15:26.846980 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.846946    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-578db4f9bf-72xs9"]
Jul 08 09:15:26.851305 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.851281    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.877159 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.877135    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-578db4f9bf-72xs9"]
Jul 08 09:15:26.923238 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923199    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923379 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923265    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-service-ca\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923379 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923296    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-oauth-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923379 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-oauth-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923519 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923412    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923519 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-trusted-ca-bundle\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:26.923588 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:26.923544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d99w5\" (UniqueName: \"kubernetes.io/projected/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-kube-api-access-d99w5\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024613 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024582    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-trusted-ca-bundle\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024749 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d99w5\" (UniqueName: \"kubernetes.io/projected/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-kube-api-access-d99w5\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024749 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024638    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024825 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024764    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-service-ca\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024825 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024809    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-oauth-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024924 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-oauth-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.024924 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.024891    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.025444 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.025409    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.025587 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.025449    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-service-ca\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.025587 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.025551    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-oauth-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.025696 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.025601    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-trusted-ca-bundle\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.027421 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.027401    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-serving-cert\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.027494 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.027401    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-console-oauth-config\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.036651 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.036630    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d99w5\" (UniqueName: \"kubernetes.io/projected/f51f4de9-07b0-42a0-8fae-3073d33ae1b6-kube-api-access-d99w5\") pod \"console-578db4f9bf-72xs9\" (UID: \"f51f4de9-07b0-42a0-8fae-3073d33ae1b6\") " pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.161477 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.161427    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:27.309961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:27.309937    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-578db4f9bf-72xs9"]
Jul 08 09:15:27.310763 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:15:27.310739    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51f4de9_07b0_42a0_8fae_3073d33ae1b6.slice/crio-dcf72a72aad8c9f503f13fea8dc3514628782731a99164029b364b44467543af WatchSource:0}: Error finding container dcf72a72aad8c9f503f13fea8dc3514628782731a99164029b364b44467543af: Status 404 returned error can't find the container with id dcf72a72aad8c9f503f13fea8dc3514628782731a99164029b364b44467543af
Jul 08 09:15:28.279431 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:28.279388    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578db4f9bf-72xs9" event={"ID":"f51f4de9-07b0-42a0-8fae-3073d33ae1b6","Type":"ContainerStarted","Data":"48465a67cf4363e3f4045b9f82ac51186ddcaa42242e84da2f2de64788c17f95"}
Jul 08 09:15:28.279843 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:28.279439    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578db4f9bf-72xs9" event={"ID":"f51f4de9-07b0-42a0-8fae-3073d33ae1b6","Type":"ContainerStarted","Data":"dcf72a72aad8c9f503f13fea8dc3514628782731a99164029b364b44467543af"}
Jul 08 09:15:28.301360 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:28.301317    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-578db4f9bf-72xs9" podStartSLOduration=2.301302683 podStartE2EDuration="2.301302683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:15:28.299755531 +0000 UTC m=+504.809529282" watchObservedRunningTime="2026-07-08 09:15:28.301302683 +0000 UTC m=+504.811076410"
Jul 08 09:15:37.162495 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:37.162445    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:37.162993 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:37.162525    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:37.167233 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:37.167208    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:37.324287 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:37.324257    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-578db4f9bf-72xs9"
Jul 08 09:15:37.397902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:15:37.397863    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:16:02.422173 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.422094    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cd4d98647-k4pjs" podUID="59e4d531-9785-4e2b-aa1a-4d08791da159" containerName="console" containerID="cri-o://a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea" gracePeriod=15
Jul 08 09:16:02.665880 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.665855    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:16:02.728068 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.727998    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728068 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728030    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728068 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728048    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728073    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728106    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728120    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728177    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68whm\" (UniqueName: \"kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm\") pod \"59e4d531-9785-4e2b-aa1a-4d08791da159\" (UID: \"59e4d531-9785-4e2b-aa1a-4d08791da159\") "
Jul 08 09:16:02.728551 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728517    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:16:02.728609 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728559    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca" (OuterVolumeSpecName: "service-ca") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:16:02.728609 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728557    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:16:02.728685 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.728610    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config" (OuterVolumeSpecName: "console-config") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 09:16:02.730285 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.730262    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:16:02.730723 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.730703    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:16:02.730784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.730760    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm" (OuterVolumeSpecName: "kube-api-access-68whm") pod "59e4d531-9785-4e2b-aa1a-4d08791da159" (UID: "59e4d531-9785-4e2b-aa1a-4d08791da159"). InnerVolumeSpecName "kube-api-access-68whm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:16:02.829172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829148    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68whm\" (UniqueName: \"kubernetes.io/projected/59e4d531-9785-4e2b-aa1a-4d08791da159-kube-api-access-68whm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829169    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-oauth-serving-cert\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829341 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829182    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-oauth-config\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829341 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829195    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-trusted-ca-bundle\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829341 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829207    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-service-ca\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829341 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829218    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59e4d531-9785-4e2b-aa1a-4d08791da159-console-serving-cert\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:02.829341 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:02.829230    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59e4d531-9785-4e2b-aa1a-4d08791da159-console-config\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:03.433575 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.433540    2547 generic.go:356] "Generic (PLEG): container finished" podID="59e4d531-9785-4e2b-aa1a-4d08791da159" containerID="a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea" exitCode=0
Jul 08 09:16:03.434006 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.433585    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd4d98647-k4pjs"
Jul 08 09:16:03.434006 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.433599    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd4d98647-k4pjs" event={"ID":"59e4d531-9785-4e2b-aa1a-4d08791da159","Type":"ContainerDied","Data":"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"}
Jul 08 09:16:03.434006 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.433651    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd4d98647-k4pjs" event={"ID":"59e4d531-9785-4e2b-aa1a-4d08791da159","Type":"ContainerDied","Data":"405a865a68c7182f66e79b758b0f4ba9ae1f2489018b3f901eaafbcded5e95c0"}
Jul 08 09:16:03.434006 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.433682    2547 scope.go:117] "RemoveContainer" containerID="a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"
Jul 08 09:16:03.442585 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.442570    2547 scope.go:117] "RemoveContainer" containerID="a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"
Jul 08 09:16:03.442837 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:16:03.442818    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea\": container with ID starting with a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea not found: ID does not exist" containerID="a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"
Jul 08 09:16:03.442879 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.442845    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea"} err="failed to get container status \"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea\": rpc error: code = NotFound desc = could not find container \"a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea\": container with ID starting with a2ffe0379b3c700227fbf68090a00dd2a449c0a675b69e08a871085b056ebcea not found: ID does not exist"
Jul 08 09:16:03.461366 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.461346    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:16:03.469370 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:03.469347    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd4d98647-k4pjs"]
Jul 08 09:16:04.034239 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:04.034209    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59e4d531-9785-4e2b-aa1a-4d08791da159" path="/var/lib/kubelet/pods/59e4d531-9785-4e2b-aa1a-4d08791da159/volumes"
Jul 08 09:16:42.393010 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.392977    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:16:42.393367 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.393283    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e4d531-9785-4e2b-aa1a-4d08791da159" containerName="console"
Jul 08 09:16:42.393367 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.393293    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e4d531-9785-4e2b-aa1a-4d08791da159" containerName="console"
Jul 08 09:16:42.393367 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.393356    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="59e4d531-9785-4e2b-aa1a-4d08791da159" containerName="console"
Jul 08 09:16:42.396289 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.396272    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.398928 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.398907    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 09:16:42.399046 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.398948    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 09:16:42.400042 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.400024    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rxqb9\""
Jul 08 09:16:42.400120 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.400057    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 09:16:42.404139 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.404119    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:16:42.418175 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.418152    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:16:42.523409 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.523386    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45882c27-e14a-4456-8ed7-75ef33d763a7-config-file\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.523527 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.523421    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mh4w\" (UniqueName: \"kubernetes.io/projected/45882c27-e14a-4456-8ed7-75ef33d763a7-kube-api-access-2mh4w\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.624229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.624152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45882c27-e14a-4456-8ed7-75ef33d763a7-config-file\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.624229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.624188    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mh4w\" (UniqueName: \"kubernetes.io/projected/45882c27-e14a-4456-8ed7-75ef33d763a7-kube-api-access-2mh4w\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.624789 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.624771    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45882c27-e14a-4456-8ed7-75ef33d763a7-config-file\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.633734 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.633702    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mh4w\" (UniqueName: \"kubernetes.io/projected/45882c27-e14a-4456-8ed7-75ef33d763a7-kube-api-access-2mh4w\") pod \"limitador-limitador-54d6d988d5-ts2dw\" (UID: \"45882c27-e14a-4456-8ed7-75ef33d763a7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.707197 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.707172    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:42.813794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.813762    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:42.817732 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.817711    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:42.820588 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.820571    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cj26j\""
Jul 08 09:16:42.830524 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.830495    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:42.846696 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.846673    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:16:42.849969 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:16:42.849943    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45882c27_e14a_4456_8ed7_75ef33d763a7.slice/crio-7a239acc497b83dbec22ba19b3d03f2253242473cdbe18cfef97bd23bdbbeef0 WatchSource:0}: Error finding container 7a239acc497b83dbec22ba19b3d03f2253242473cdbe18cfef97bd23bdbbeef0: Status 404 returned error can't find the container with id 7a239acc497b83dbec22ba19b3d03f2253242473cdbe18cfef97bd23bdbbeef0
Jul 08 09:16:42.927442 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:42.927415    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxr4\" (UniqueName: \"kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4\") pod \"authorino-58cd955675-5drd9\" (UID: \"44234858-2e19-4d95-8681-13d8104b291d\") " pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:43.011010 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.010982    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:16:43.014210 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.014193    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:16:43.023951 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.023927    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:16:43.028836 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.028810    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxr4\" (UniqueName: \"kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4\") pod \"authorino-58cd955675-5drd9\" (UID: \"44234858-2e19-4d95-8681-13d8104b291d\") " pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:43.037925 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.037898    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxr4\" (UniqueName: \"kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4\") pod \"authorino-58cd955675-5drd9\" (UID: \"44234858-2e19-4d95-8681-13d8104b291d\") " pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:43.127019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.126995    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:43.129352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.129333    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cl6w\" (UniqueName: \"kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w\") pod \"authorino-75d556bd77-69pb5\" (UID: \"dca04d4e-b4f3-42e4-800d-f7a758c25909\") " pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:16:43.229982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.229957    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cl6w\" (UniqueName: \"kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w\") pod \"authorino-75d556bd77-69pb5\" (UID: \"dca04d4e-b4f3-42e4-800d-f7a758c25909\") " pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:16:43.240215 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.240179    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cl6w\" (UniqueName: \"kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w\") pod \"authorino-75d556bd77-69pb5\" (UID: \"dca04d4e-b4f3-42e4-800d-f7a758c25909\") " pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:16:43.256587 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.256505    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:43.258695 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:16:43.258672    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44234858_2e19_4d95_8681_13d8104b291d.slice/crio-762456ad5a95f1909c1e49092c67ab5d779138c4b25854cba2ebcf9b9116af3a WatchSource:0}: Error finding container 762456ad5a95f1909c1e49092c67ab5d779138c4b25854cba2ebcf9b9116af3a: Status 404 returned error can't find the container with id 762456ad5a95f1909c1e49092c67ab5d779138c4b25854cba2ebcf9b9116af3a
Jul 08 09:16:43.323546 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.323508    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:16:43.500527 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.500375    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:16:43.505805 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:16:43.505774    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca04d4e_b4f3_42e4_800d_f7a758c25909.slice/crio-307bf501fed303177538a054bea2eecd3d23cffcbb6039e42679c5ce71e7dddf WatchSource:0}: Error finding container 307bf501fed303177538a054bea2eecd3d23cffcbb6039e42679c5ce71e7dddf: Status 404 returned error can't find the container with id 307bf501fed303177538a054bea2eecd3d23cffcbb6039e42679c5ce71e7dddf
Jul 08 09:16:43.619299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.619231    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5drd9" event={"ID":"44234858-2e19-4d95-8681-13d8104b291d","Type":"ContainerStarted","Data":"762456ad5a95f1909c1e49092c67ab5d779138c4b25854cba2ebcf9b9116af3a"}
Jul 08 09:16:43.621287 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.621259    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw" event={"ID":"45882c27-e14a-4456-8ed7-75ef33d763a7","Type":"ContainerStarted","Data":"7a239acc497b83dbec22ba19b3d03f2253242473cdbe18cfef97bd23bdbbeef0"}
Jul 08 09:16:43.623201 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:43.623165    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-69pb5" event={"ID":"dca04d4e-b4f3-42e4-800d-f7a758c25909","Type":"ContainerStarted","Data":"307bf501fed303177538a054bea2eecd3d23cffcbb6039e42679c5ce71e7dddf"}
Jul 08 09:16:48.659108 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.658902    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5drd9" event={"ID":"44234858-2e19-4d95-8681-13d8104b291d","Type":"ContainerStarted","Data":"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"}
Jul 08 09:16:48.660774 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.660744    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw" event={"ID":"45882c27-e14a-4456-8ed7-75ef33d763a7","Type":"ContainerStarted","Data":"e13d9329bb43b266f0575a5c6e77642998d500b9def67ce9e66b77a624859ffd"}
Jul 08 09:16:48.660892 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.660830    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:16:48.662172 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.662147    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-69pb5" event={"ID":"dca04d4e-b4f3-42e4-800d-f7a758c25909","Type":"ContainerStarted","Data":"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"}
Jul 08 09:16:48.680225 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.680184    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5drd9" podStartSLOduration=2.212362016 podStartE2EDuration="6.680170874s" totalImagesPullingTime="4.467808858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:16:48.679624606 +0000 UTC m=+585.189398336" watchObservedRunningTime="2026-07-08 09:16:48.680170874 +0000 UTC m=+585.189944601"
Jul 08 09:16:48.696109 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.696058    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-69pb5" podStartSLOduration=2.456872533 podStartE2EDuration="6.696039571s" totalImagesPullingTime="4.239167038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:16:48.694801621 +0000 UTC m=+585.204575343" watchObservedRunningTime="2026-07-08 09:16:48.696039571 +0000 UTC m=+585.205813300"
Jul 08 09:16:48.712862 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.712825    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw" podStartSLOduration=1.8349768069999999 podStartE2EDuration="6.712812592s" totalImagesPullingTime="4.877835785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:16:48.712029928 +0000 UTC m=+585.221803656" watchObservedRunningTime="2026-07-08 09:16:48.712812592 +0000 UTC m=+585.222586347"
Jul 08 09:16:48.724598 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:48.724573    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:50.671308 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:50.671272    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5drd9" podUID="44234858-2e19-4d95-8681-13d8104b291d" containerName="authorino" containerID="cri-o://bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769" gracePeriod=30
Jul 08 09:16:50.919473 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:50.919430    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:51.095699 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.095627    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlxr4\" (UniqueName: \"kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4\") pod \"44234858-2e19-4d95-8681-13d8104b291d\" (UID: \"44234858-2e19-4d95-8681-13d8104b291d\") "
Jul 08 09:16:51.097627 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.097605    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4" (OuterVolumeSpecName: "kube-api-access-mlxr4") pod "44234858-2e19-4d95-8681-13d8104b291d" (UID: "44234858-2e19-4d95-8681-13d8104b291d"). InnerVolumeSpecName "kube-api-access-mlxr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:16:51.196704 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.196678    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlxr4\" (UniqueName: \"kubernetes.io/projected/44234858-2e19-4d95-8681-13d8104b291d-kube-api-access-mlxr4\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:16:51.677122 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.677087    2547 generic.go:356] "Generic (PLEG): container finished" podID="44234858-2e19-4d95-8681-13d8104b291d" containerID="bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769" exitCode=0
Jul 08 09:16:51.677558 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.677129    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5drd9"
Jul 08 09:16:51.677558 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.677175    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5drd9" event={"ID":"44234858-2e19-4d95-8681-13d8104b291d","Type":"ContainerDied","Data":"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"}
Jul 08 09:16:51.677558 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.677224    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5drd9" event={"ID":"44234858-2e19-4d95-8681-13d8104b291d","Type":"ContainerDied","Data":"762456ad5a95f1909c1e49092c67ab5d779138c4b25854cba2ebcf9b9116af3a"}
Jul 08 09:16:51.677558 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.677252    2547 scope.go:117] "RemoveContainer" containerID="bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"
Jul 08 09:16:51.685206 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.685188    2547 scope.go:117] "RemoveContainer" containerID="bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"
Jul 08 09:16:51.685443 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:16:51.685423    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769\": container with ID starting with bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769 not found: ID does not exist" containerID="bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"
Jul 08 09:16:51.685526 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.685450    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769"} err="failed to get container status \"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769\": rpc error: code = NotFound desc = could not find container \"bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769\": container with ID starting with bad2fe17f180cc4c413a484f375f179f115bcec85256e0f4a8c9a674afc87769 not found: ID does not exist"
Jul 08 09:16:51.699469 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.699441    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:51.702423 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:51.702405    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5drd9"]
Jul 08 09:16:52.033951 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:52.033874    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44234858-2e19-4d95-8681-13d8104b291d" path="/var/lib/kubelet/pods/44234858-2e19-4d95-8681-13d8104b291d/volumes"
Jul 08 09:16:59.667811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:16:59.667779    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"
Jul 08 09:17:03.898042 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:03.898012    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:17:03.901999 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:03.901979    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:17:03.902123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:03.902038    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:17:03.906411 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:03.906394    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:17:15.325412 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.325382    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:15.327727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.325721    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44234858-2e19-4d95-8681-13d8104b291d" containerName="authorino"
Jul 08 09:17:15.327727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.325732    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="44234858-2e19-4d95-8681-13d8104b291d" containerName="authorino"
Jul 08 09:17:15.327727 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.325784    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="44234858-2e19-4d95-8681-13d8104b291d" containerName="authorino"
Jul 08 09:17:15.328561 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.328545    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:15.336190 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.336169    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:15.373984 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.373953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kk4c\" (UniqueName: \"kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c\") pod \"authorino-5d4b67c446-28fqw\" (UID: \"ce6c056f-ceb8-4835-89cd-79cf4982c139\") " pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:15.474631 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.474607    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kk4c\" (UniqueName: \"kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c\") pod \"authorino-5d4b67c446-28fqw\" (UID: \"ce6c056f-ceb8-4835-89cd-79cf4982c139\") " pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:15.482890 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.482868    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kk4c\" (UniqueName: \"kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c\") pod \"authorino-5d4b67c446-28fqw\" (UID: \"ce6c056f-ceb8-4835-89cd-79cf4982c139\") " pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:15.562532 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.562508    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:15.562695 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.562684    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:15.586803 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.586747    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d46449fd9-qdhww"]
Jul 08 09:17:15.590100 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.590081    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.597834 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.597812    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d46449fd9-qdhww"]
Jul 08 09:17:15.618979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.618954    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d46449fd9-qdhww"]
Jul 08 09:17:15.619258 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:17:15.619235    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k7n5q], unattached volumes=[], failed to process volumes=[kube-api-access-k7n5q]: context canceled" pod="kuadrant-system/authorino-d46449fd9-qdhww" podUID="b8fff171-4c16-4b94-b450-59ed07d4217d"
Jul 08 09:17:15.642591 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.642562    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:17:15.645864 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.645745    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.648767 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.648739    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 09:17:15.656229 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.656207    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:17:15.677076 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.677048    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7n5q\" (UniqueName: \"kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q\") pod \"authorino-d46449fd9-qdhww\" (UID: \"b8fff171-4c16-4b94-b450-59ed07d4217d\") " pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.677228 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.677210    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtjf\" (UniqueName: \"kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.677296 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.677285    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.694282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.694265    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:15.696941 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:17:15.696921    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6c056f_ceb8_4835_89cd_79cf4982c139.slice/crio-060d7aee16199648c10b0f2cc3648b350467b66522eb53f00907091203fa6955 WatchSource:0}: Error finding container 060d7aee16199648c10b0f2cc3648b350467b66522eb53f00907091203fa6955: Status 404 returned error can't find the container with id 060d7aee16199648c10b0f2cc3648b350467b66522eb53f00907091203fa6955
Jul 08 09:17:15.777905 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.777883    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7n5q\" (UniqueName: \"kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q\") pod \"authorino-d46449fd9-qdhww\" (UID: \"b8fff171-4c16-4b94-b450-59ed07d4217d\") " pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.778017 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.777926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtjf\" (UniqueName: \"kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.778017 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.778007    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.780207 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.780187    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.787210 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.787174    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtjf\" (UniqueName: \"kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf\") pod \"authorino-7997b5674f-qffsf\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") " pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.787361 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.787303    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7n5q\" (UniqueName: \"kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q\") pod \"authorino-d46449fd9-qdhww\" (UID: \"b8fff171-4c16-4b94-b450-59ed07d4217d\") " pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.790392 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.790363    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28fqw" event={"ID":"ce6c056f-ceb8-4835-89cd-79cf4982c139","Type":"ContainerStarted","Data":"060d7aee16199648c10b0f2cc3648b350467b66522eb53f00907091203fa6955"}
Jul 08 09:17:15.790392 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.790389    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.798011 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.797996    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:15.878501 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.878430    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7n5q\" (UniqueName: \"kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q\") pod \"b8fff171-4c16-4b94-b450-59ed07d4217d\" (UID: \"b8fff171-4c16-4b94-b450-59ed07d4217d\") "
Jul 08 09:17:15.880179 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.880162    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q" (OuterVolumeSpecName: "kube-api-access-k7n5q") pod "b8fff171-4c16-4b94-b450-59ed07d4217d" (UID: "b8fff171-4c16-4b94-b450-59ed07d4217d"). InnerVolumeSpecName "kube-api-access-k7n5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:17:15.957338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.957316    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:17:15.979385 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:15.979363    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7n5q\" (UniqueName: \"kubernetes.io/projected/b8fff171-4c16-4b94-b450-59ed07d4217d-kube-api-access-k7n5q\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:17:16.092911 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.092811    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:17:16.094933 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:17:16.094909    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod388d738a_2084_43b7_af3e_c674561abf7e.slice/crio-9f0aca66ef6823b2e87b32d6f946f61d41a10855d77266edc39c27fb13d5f0a9 WatchSource:0}: Error finding container 9f0aca66ef6823b2e87b32d6f946f61d41a10855d77266edc39c27fb13d5f0a9: Status 404 returned error can't find the container with id 9f0aca66ef6823b2e87b32d6f946f61d41a10855d77266edc39c27fb13d5f0a9
Jul 08 09:17:16.795913 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.795831    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7997b5674f-qffsf" event={"ID":"388d738a-2084-43b7-af3e-c674561abf7e","Type":"ContainerStarted","Data":"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"}
Jul 08 09:17:16.795913 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.795876    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7997b5674f-qffsf" event={"ID":"388d738a-2084-43b7-af3e-c674561abf7e","Type":"ContainerStarted","Data":"9f0aca66ef6823b2e87b32d6f946f61d41a10855d77266edc39c27fb13d5f0a9"}
Jul 08 09:17:16.797319 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.797290    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28fqw" event={"ID":"ce6c056f-ceb8-4835-89cd-79cf4982c139","Type":"ContainerStarted","Data":"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"}
Jul 08 09:17:16.797470 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.797334    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d46449fd9-qdhww"
Jul 08 09:17:16.797470 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.797349    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-28fqw" podUID="ce6c056f-ceb8-4835-89cd-79cf4982c139" containerName="authorino" containerID="cri-o://25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f" gracePeriod=30
Jul 08 09:17:16.814317 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.814277    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7997b5674f-qffsf" podStartSLOduration=1.374917993 podStartE2EDuration="1.814264899s" totalImagesPullingTime="439.346906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:17:16.812673254 +0000 UTC m=+613.322446987" watchObservedRunningTime="2026-07-08 09:17:16.814264899 +0000 UTC m=+613.324038626"
Jul 08 09:17:16.834674 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.834650    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d46449fd9-qdhww"]
Jul 08 09:17:16.841418 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.841397    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:17:16.841748 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.841720    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-69pb5" podUID="dca04d4e-b4f3-42e4-800d-f7a758c25909" containerName="authorino" containerID="cri-o://eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9" gracePeriod=30
Jul 08 09:17:16.843299 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.843278    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d46449fd9-qdhww"]
Jul 08 09:17:16.861189 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:16.861150    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-28fqw" podStartSLOduration=1.401215 podStartE2EDuration="1.861137249s" totalImagesPullingTime="459.922249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:17:16.859932862 +0000 UTC m=+613.369706589" watchObservedRunningTime="2026-07-08 09:17:16.861137249 +0000 UTC m=+613.370910976"
Jul 08 09:17:17.096773 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.096749    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:17.103515 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.103493    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:17:17.187037 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.187008    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cl6w\" (UniqueName: \"kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w\") pod \"dca04d4e-b4f3-42e4-800d-f7a758c25909\" (UID: \"dca04d4e-b4f3-42e4-800d-f7a758c25909\") "
Jul 08 09:17:17.187190 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.187059    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kk4c\" (UniqueName: \"kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c\") pod \"ce6c056f-ceb8-4835-89cd-79cf4982c139\" (UID: \"ce6c056f-ceb8-4835-89cd-79cf4982c139\") "
Jul 08 09:17:17.188941 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.188918    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c" (OuterVolumeSpecName: "kube-api-access-2kk4c") pod "ce6c056f-ceb8-4835-89cd-79cf4982c139" (UID: "ce6c056f-ceb8-4835-89cd-79cf4982c139"). InnerVolumeSpecName "kube-api-access-2kk4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:17:17.189024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.188979    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w" (OuterVolumeSpecName: "kube-api-access-4cl6w") pod "dca04d4e-b4f3-42e4-800d-f7a758c25909" (UID: "dca04d4e-b4f3-42e4-800d-f7a758c25909"). InnerVolumeSpecName "kube-api-access-4cl6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:17:17.288665 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.288642    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cl6w\" (UniqueName: \"kubernetes.io/projected/dca04d4e-b4f3-42e4-800d-f7a758c25909-kube-api-access-4cl6w\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:17:17.288665 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.288662    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kk4c\" (UniqueName: \"kubernetes.io/projected/ce6c056f-ceb8-4835-89cd-79cf4982c139-kube-api-access-2kk4c\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:17:17.803136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.803052    2547 generic.go:356] "Generic (PLEG): container finished" podID="dca04d4e-b4f3-42e4-800d-f7a758c25909" containerID="eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9" exitCode=0
Jul 08 09:17:17.803136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.803092    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-69pb5"
Jul 08 09:17:17.803606 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.803139    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-69pb5" event={"ID":"dca04d4e-b4f3-42e4-800d-f7a758c25909","Type":"ContainerDied","Data":"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"}
Jul 08 09:17:17.803606 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.803181    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-69pb5" event={"ID":"dca04d4e-b4f3-42e4-800d-f7a758c25909","Type":"ContainerDied","Data":"307bf501fed303177538a054bea2eecd3d23cffcbb6039e42679c5ce71e7dddf"}
Jul 08 09:17:17.803606 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.803202    2547 scope.go:117] "RemoveContainer" containerID="eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"
Jul 08 09:17:17.804529 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.804412    2547 generic.go:356] "Generic (PLEG): container finished" podID="ce6c056f-ceb8-4835-89cd-79cf4982c139" containerID="25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f" exitCode=0
Jul 08 09:17:17.804529 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.804472    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28fqw"
Jul 08 09:17:17.804529 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.804483    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28fqw" event={"ID":"ce6c056f-ceb8-4835-89cd-79cf4982c139","Type":"ContainerDied","Data":"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"}
Jul 08 09:17:17.804529 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.804520    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28fqw" event={"ID":"ce6c056f-ceb8-4835-89cd-79cf4982c139","Type":"ContainerDied","Data":"060d7aee16199648c10b0f2cc3648b350467b66522eb53f00907091203fa6955"}
Jul 08 09:17:17.812852 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.812624    2547 scope.go:117] "RemoveContainer" containerID="eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"
Jul 08 09:17:17.812923 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:17:17.812863    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9\": container with ID starting with eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9 not found: ID does not exist" containerID="eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"
Jul 08 09:17:17.812923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.812897    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9"} err="failed to get container status \"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9\": rpc error: code = NotFound desc = could not find container \"eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9\": container with ID starting with eb2f561e7f24a37a98b01a7c31ce09f782d5e823983bffaee70099fa7d047ef9 not found: ID does not exist"
Jul 08 09:17:17.812923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.812918    2547 scope.go:117] "RemoveContainer" containerID="25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"
Jul 08 09:17:17.820195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.820177    2547 scope.go:117] "RemoveContainer" containerID="25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"
Jul 08 09:17:17.820484 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:17:17.820449    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f\": container with ID starting with 25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f not found: ID does not exist" containerID="25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"
Jul 08 09:17:17.820531 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.820492    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f"} err="failed to get container status \"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f\": rpc error: code = NotFound desc = could not find container \"25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f\": container with ID starting with 25314426fcc076877fb569667d9972f567b68bcc845c461032857ba2a870011f not found: ID does not exist"
Jul 08 09:17:17.828525 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.828505    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:17:17.831559 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.831539    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-69pb5"]
Jul 08 09:17:17.841758 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.841735    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:17.845605 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:17.845585    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28fqw"]
Jul 08 09:17:18.034492 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:18.034449    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fff171-4c16-4b94-b450-59ed07d4217d" path="/var/lib/kubelet/pods/b8fff171-4c16-4b94-b450-59ed07d4217d/volumes"
Jul 08 09:17:18.034700 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:18.034688    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6c056f-ceb8-4835-89cd-79cf4982c139" path="/var/lib/kubelet/pods/ce6c056f-ceb8-4835-89cd-79cf4982c139/volumes"
Jul 08 09:17:18.034973 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:18.034962    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca04d4e-b4f3-42e4-800d-f7a758c25909" path="/var/lib/kubelet/pods/dca04d4e-b4f3-42e4-800d-f7a758c25909/volumes"
Jul 08 09:17:57.201485 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:17:57.201439    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:17.594483 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:17.594423    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:21.236181 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:21.236148    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:25.579103 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:25.579069    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:43.784176 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:43.784146    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:52.084557 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084525    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"]
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084858    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca04d4e-b4f3-42e4-800d-f7a758c25909" containerName="authorino"
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084870    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca04d4e-b4f3-42e4-800d-f7a758c25909" containerName="authorino"
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084896    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6c056f-ceb8-4835-89cd-79cf4982c139" containerName="authorino"
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084902    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6c056f-ceb8-4835-89cd-79cf4982c139" containerName="authorino"
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084957    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6c056f-ceb8-4835-89cd-79cf4982c139" containerName="authorino"
Jul 08 09:18:52.084979 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.084970    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca04d4e-b4f3-42e4-800d-f7a758c25909" containerName="authorino"
Jul 08 09:18:52.088002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.087985    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.092045 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.092020    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 09:18:52.092045 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.092034    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2rf8\""
Jul 08 09:18:52.092226 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.092092    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 09:18:52.092226 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.092115    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 09:18:52.097547 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.097522    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"]
Jul 08 09:18:52.224434 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224399    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.224619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224476    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.224619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224499    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.224619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224526    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2r9h\" (UniqueName: \"kubernetes.io/projected/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-kube-api-access-j2r9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.224619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224567    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.224619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.224584    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325164 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325123    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325164 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325170    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325398 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325211    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2r9h\" (UniqueName: \"kubernetes.io/projected/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-kube-api-access-j2r9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325398 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325250    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325398 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325278    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325398 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325324    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325814 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325788    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325898 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325803    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.325898 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.325839    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.327629 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.327608    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.327786 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.327770    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.333129 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.333108    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2r9h\" (UniqueName: \"kubernetes.io/projected/48d7d88b-bf91-4016-ab09-0f5a3d4df70c-kube-api-access-j2r9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g7bwf\" (UID: \"48d7d88b-bf91-4016-ab09-0f5a3d4df70c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.399381 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.399343    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:18:52.531641 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.531618    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"]
Jul 08 09:18:52.533861 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:18:52.533825    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d7d88b_bf91_4016_ab09_0f5a3d4df70c.slice/crio-e7d3e45d0e5ce29e05038bad76375d281b8b8e559494052f64aee6cc15aa15b2 WatchSource:0}: Error finding container e7d3e45d0e5ce29e05038bad76375d281b8b8e559494052f64aee6cc15aa15b2: Status 404 returned error can't find the container with id e7d3e45d0e5ce29e05038bad76375d281b8b8e559494052f64aee6cc15aa15b2
Jul 08 09:18:52.535300 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:52.535279    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 09:18:53.230206 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:53.230164    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf" event={"ID":"48d7d88b-bf91-4016-ab09-0f5a3d4df70c","Type":"ContainerStarted","Data":"e7d3e45d0e5ce29e05038bad76375d281b8b8e559494052f64aee6cc15aa15b2"}
Jul 08 09:18:53.987804 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:53.987766    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:18:54.237139 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:54.237103    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf" event={"ID":"48d7d88b-bf91-4016-ab09-0f5a3d4df70c","Type":"ContainerStarted","Data":"d36d305489a7cc5a1367225e9045eb94cd4b9ae2640b789d56bae3d8c2d5cc95"}
Jul 08 09:18:54.257377 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:18:54.257277    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf" podStartSLOduration=1.219735435 podStartE2EDuration="2.257259272s" totalImagesPullingTime="1.037523837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:18:54.256643905 +0000 UTC m=+710.766417656" watchObservedRunningTime="2026-07-08 09:18:54.257259272 +0000 UTC m=+710.767032998"
Jul 08 09:19:02.400535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:02.400404    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:19:02.400535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:02.400493    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:19:02.413361 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:02.413331    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:19:03.292037 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.292004    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g7bwf"
Jul 08 09:19:03.794297 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.794267    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"]
Jul 08 09:19:03.797532 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.797514    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.801160 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.801139    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 09:19:03.810161 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.810138    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"]
Jul 08 09:19:03.926596 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926559    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.926784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926612    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.926784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926632    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.926784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926684    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.926784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926739    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:03.926784 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:03.926763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctldb\" (UniqueName: \"kubernetes.io/projected/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-kube-api-access-ctldb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027305    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027364    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027409    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027439    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027502    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027542 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027527    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctldb\" (UniqueName: \"kubernetes.io/projected/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-kube-api-access-ctldb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027806 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027768    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027891 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.027946 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.027879    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.029662 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.029638    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.030589 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.030573    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 09:19:04.036516 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.036495    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctldb\" (UniqueName: \"kubernetes.io/projected/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-kube-api-access-ctldb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.040206 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.040180    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc59a00d-d63e-4dbd-9c7a-e576919e03fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m\" (UID: \"fc59a00d-d63e-4dbd-9c7a-e576919e03fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.106636 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.106556    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:04.242082 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.242061    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"]
Jul 08 09:19:04.243115 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:19:04.243093    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc59a00d_d63e_4dbd_9c7a_e576919e03fe.slice/crio-a79984e8d15eeaeb305c9b29021ea51821a6af86b3c7b4175e215b165f72e5fa WatchSource:0}: Error finding container a79984e8d15eeaeb305c9b29021ea51821a6af86b3c7b4175e215b165f72e5fa: Status 404 returned error can't find the container with id a79984e8d15eeaeb305c9b29021ea51821a6af86b3c7b4175e215b165f72e5fa
Jul 08 09:19:04.287472 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:04.287422    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m" event={"ID":"fc59a00d-d63e-4dbd-9c7a-e576919e03fe","Type":"ContainerStarted","Data":"a79984e8d15eeaeb305c9b29021ea51821a6af86b3c7b4175e215b165f72e5fa"}
Jul 08 09:19:05.294294 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:05.294262    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m" event={"ID":"fc59a00d-d63e-4dbd-9c7a-e576919e03fe","Type":"ContainerStarted","Data":"9a77b7a0d365f2e7e79ed094d8ecacf8ff90c5b54871c5d77123bab3574242fa"}
Jul 08 09:19:05.314842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:05.314787    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m" podStartSLOduration=2.090625497 podStartE2EDuration="2.314773768s" totalImagesPullingTime="224.148271ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:19:05.313012787 +0000 UTC m=+721.822786515" watchObservedRunningTime="2026-07-08 09:19:05.314773768 +0000 UTC m=+721.824547495"
Jul 08 09:19:06.194496 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:06.194429    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:19:14.106783 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:14.106750    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:14.107260 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:14.106802    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:14.120669 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:14.120643    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:14.347973 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:14.347943    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m"
Jul 08 09:19:44.301611 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.301573    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c674bdc68-jtpwr"]
Jul 08 09:19:44.304754 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.304736    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.317671 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.317641    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c674bdc68-jtpwr"]
Jul 08 09:19:44.377352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.377316    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wht\" (UniqueName: \"kubernetes.io/projected/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-kube-api-access-k4wht\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.377352 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.377365    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-tls-cert\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.478830 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.478800    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wht\" (UniqueName: \"kubernetes.io/projected/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-kube-api-access-k4wht\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.478997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.478844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-tls-cert\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.481188 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.481159    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-tls-cert\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.488705 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.488683    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wht\" (UniqueName: \"kubernetes.io/projected/8f856ca0-b9bb-405b-8563-80f5fe02e0a1-kube-api-access-k4wht\") pod \"authorino-5c674bdc68-jtpwr\" (UID: \"8f856ca0-b9bb-405b-8563-80f5fe02e0a1\") " pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.613928 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.613838    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c674bdc68-jtpwr"
Jul 08 09:19:44.775731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:44.775706    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c674bdc68-jtpwr"]
Jul 08 09:19:44.777780 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:19:44.777753    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f856ca0_b9bb_405b_8563_80f5fe02e0a1.slice/crio-f1deeb6dcb9b2731e19aa91eef1946343fdfe10a45c8606d6bb7b8ce3c5c590c WatchSource:0}: Error finding container f1deeb6dcb9b2731e19aa91eef1946343fdfe10a45c8606d6bb7b8ce3c5c590c: Status 404 returned error can't find the container with id f1deeb6dcb9b2731e19aa91eef1946343fdfe10a45c8606d6bb7b8ce3c5c590c
Jul 08 09:19:45.485382 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.485274    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c674bdc68-jtpwr" event={"ID":"8f856ca0-b9bb-405b-8563-80f5fe02e0a1","Type":"ContainerStarted","Data":"4f73a88db11619cade5e83a1f1b9c8edcbaf581969b47cef2a38dfca7dacf317"}
Jul 08 09:19:45.485922 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.485896    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c674bdc68-jtpwr" event={"ID":"8f856ca0-b9bb-405b-8563-80f5fe02e0a1","Type":"ContainerStarted","Data":"f1deeb6dcb9b2731e19aa91eef1946343fdfe10a45c8606d6bb7b8ce3c5c590c"}
Jul 08 09:19:45.552337 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.552269    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c674bdc68-jtpwr" podStartSLOduration=1.133570219 podStartE2EDuration="1.552242217s" totalImagesPullingTime="418.671998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:19:45.509218158 +0000 UTC m=+762.018991914" watchObservedRunningTime="2026-07-08 09:19:45.552242217 +0000 UTC m=+762.062015945"
Jul 08 09:19:45.553684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.553658    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:19:45.553922 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.553890    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7997b5674f-qffsf" podUID="388d738a-2084-43b7-af3e-c674561abf7e" containerName="authorino" containerID="cri-o://966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a" gracePeriod=30
Jul 08 09:19:45.818488 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.818438    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:19:45.892132 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.892097    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjtjf\" (UniqueName: \"kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf\") pod \"388d738a-2084-43b7-af3e-c674561abf7e\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") "
Jul 08 09:19:45.892301 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.892213    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert\") pod \"388d738a-2084-43b7-af3e-c674561abf7e\" (UID: \"388d738a-2084-43b7-af3e-c674561abf7e\") "
Jul 08 09:19:45.894433 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.894404    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf" (OuterVolumeSpecName: "kube-api-access-fjtjf") pod "388d738a-2084-43b7-af3e-c674561abf7e" (UID: "388d738a-2084-43b7-af3e-c674561abf7e"). InnerVolumeSpecName "kube-api-access-fjtjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:19:45.904699 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.904663    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "388d738a-2084-43b7-af3e-c674561abf7e" (UID: "388d738a-2084-43b7-af3e-c674561abf7e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:19:45.993197 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.993161    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjtjf\" (UniqueName: \"kubernetes.io/projected/388d738a-2084-43b7-af3e-c674561abf7e-kube-api-access-fjtjf\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:19:45.993197 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:45.993190    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/388d738a-2084-43b7-af3e-c674561abf7e-tls-cert\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:19:46.492295 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.492260    2547 generic.go:356] "Generic (PLEG): container finished" podID="388d738a-2084-43b7-af3e-c674561abf7e" containerID="966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a" exitCode=0
Jul 08 09:19:46.492694 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.492303    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7997b5674f-qffsf"
Jul 08 09:19:46.492694 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.492343    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7997b5674f-qffsf" event={"ID":"388d738a-2084-43b7-af3e-c674561abf7e","Type":"ContainerDied","Data":"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"}
Jul 08 09:19:46.492694 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.492389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7997b5674f-qffsf" event={"ID":"388d738a-2084-43b7-af3e-c674561abf7e","Type":"ContainerDied","Data":"9f0aca66ef6823b2e87b32d6f946f61d41a10855d77266edc39c27fb13d5f0a9"}
Jul 08 09:19:46.492694 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.492406    2547 scope.go:117] "RemoveContainer" containerID="966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"
Jul 08 09:19:46.501261 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.501232    2547 scope.go:117] "RemoveContainer" containerID="966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"
Jul 08 09:19:46.501615 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:19:46.501586    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a\": container with ID starting with 966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a not found: ID does not exist" containerID="966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"
Jul 08 09:19:46.501706 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.501619    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a"} err="failed to get container status \"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a\": rpc error: code = NotFound desc = could not find container \"966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a\": container with ID starting with 966bb4433762db8b0ac2969d86c2ab31fec91d56482989d298e84262a05df32a not found: ID does not exist"
Jul 08 09:19:46.523241 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.523212    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:19:46.528772 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:46.528752    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7997b5674f-qffsf"]
Jul 08 09:19:48.034290 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:19:48.034256    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="388d738a-2084-43b7-af3e-c674561abf7e" path="/var/lib/kubelet/pods/388d738a-2084-43b7-af3e-c674561abf7e/volumes"
Jul 08 09:20:13.780930 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:20:13.780893    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:20:24.197396 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:20:24.197359    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:20:34.203788 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:20:34.203703    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:20:44.209740 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:20:44.209702    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:20:54.596564 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:20:54.596521    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:21:21.889886 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:21:21.889845    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:21:35.894501 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:21:35.894445    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:03.928020 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:03.927948    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:22:03.928711 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:03.928690    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:22:03.932212 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:03.932193    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:22:03.933137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:03.933121    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:22:10.980558 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:10.980524    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:20.076193 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:20.076162    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:28.484526 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:28.484486    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:37.488787 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:37.488756    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:48.998085 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:48.998049    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:22:58.093380 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:22:58.093345    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:23:09.482699 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:23:09.482662    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:23:19.086472 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:23:19.086425    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:23:41.783401 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:23:41.783326    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:23:52.990267 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:23:52.990237    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:24:17.485065 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:24:17.485025    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:24:27.693514 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:24:27.693479    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:24:42.379968 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:24:42.379935    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:24:51.101166 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:24:51.101134    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:25:00.224752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:25:00.224670    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:25:10.388252 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:25:10.388216    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:25:19.087974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:25:19.087933    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:27:03.957198 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:03.957172    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:27:03.958181 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:03.958159    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:27:03.961390 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:03.961369    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:27:03.962337 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:03.962317    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:27:09.689159 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:09.689125    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:27:19.030434 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:19.030395    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:27:31.232161 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:31.232125    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:27:42.593846 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:42.593799    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:27:54.194735 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:27:54.194706    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:04.201503 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:04.201414    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:13.952550 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:13.952519    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:24.288521 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:24.288489    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:36.181685 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:36.181654    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:44.504963 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:44.504931    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:28:54.981028 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:28:54.981001    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:29:00.292544 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:29:00.292509    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:29:31.282489 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:29:31.282394    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:29:38.398465 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:29:38.398414    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:29:47.500083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:29:47.500043    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:29:59.108484 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:29:59.108420    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:08.588964 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:08.588929    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:19.626808 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:19.626756    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:30.221859 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:30.221824    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:39.600432 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:39.600395    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:48.691798 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:48.691766    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:30:58.589246 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:30:58.589172    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:07.197837 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:07.197806    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:12.779882 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:12.779849    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:22.024166 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:22.024124    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:30.992219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:30.992180    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:40.511029 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:40.510995    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:31:52.384614 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:31:52.384579    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:32:03.179974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:03.179939    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:32:03.983211 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:03.983183    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:32:03.985340 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:03.985317    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:32:03.987251 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:03.987232    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:32:03.995625 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:03.995606    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:32:11.192589 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:11.192554    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:32:22.997881 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:22.997845    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:32:34.596911 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:34.596877    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:32:43.999767 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:32:43.999726    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:33:03.647968 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:33:03.647936    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:33:10.089029 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:33:10.089000    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:35:07.899670 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:35:07.899638    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:35:16.496594 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:35:16.496561    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:35:29.507710 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:35:29.507635    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:35:40.036039 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:35:40.036006    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:36:09.590334 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:09.590300    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:36:26.105342 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.105304    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:36:26.105931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.105826    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388d738a-2084-43b7-af3e-c674561abf7e" containerName="authorino"
Jul 08 09:36:26.105931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.105845    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="388d738a-2084-43b7-af3e-c674561abf7e" containerName="authorino"
Jul 08 09:36:26.105931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.105923    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="388d738a-2084-43b7-af3e-c674561abf7e" containerName="authorino"
Jul 08 09:36:26.108931 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.108910    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.113841 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.113809    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0775092a\"/\"kube-root-ca.crt\""
Jul 08 09:36:26.113981 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.113875    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0775092a\"/\"openshift-service-ca.crt\""
Jul 08 09:36:26.113981 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.113916    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0775092a\"/\"e2e-lifecycle-model-0775092a-kserve-self-signed-certs\""
Jul 08 09:36:26.113981 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.113935    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0775092a\"/\"default-dockercfg-q9xz9\""
Jul 08 09:36:26.120108 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.120086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:36:26.201047 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtqb\" (UniqueName: \"kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.201169 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.201214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.201214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201190    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.201294 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201214    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.201294 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.201243    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302485 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302431    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302630 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302504    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302630 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302530    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302630 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302548    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302630 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302567    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtqb\" (UniqueName: \"kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302839 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302626    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.302946 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302925    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.303006 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.302952    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.303046 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.303018    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.304671 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.304651    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.304990 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.304973    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.312867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.312843    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtqb\" (UniqueName: \"kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb\") pod \"e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") " pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.418112 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.418086    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:26.557201 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:26.557172    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:36:26.559903 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:36:26.559880    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1079895_9322_484d_a404_0b9be8908cd2.slice/crio-c4196215e9f12edee33c5cca54f14ec6f7caa0fb463b2c94089dc3790689b1a0 WatchSource:0}: Error finding container c4196215e9f12edee33c5cca54f14ec6f7caa0fb463b2c94089dc3790689b1a0: Status 404 returned error can't find the container with id c4196215e9f12edee33c5cca54f14ec6f7caa0fb463b2c94089dc3790689b1a0
Jul 08 09:36:27.102026 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:27.101995    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" event={"ID":"e1079895-9322-484d-a404-0b9be8908cd2","Type":"ContainerStarted","Data":"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"}
Jul 08 09:36:27.102181 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:27.102032    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" event={"ID":"e1079895-9322-484d-a404-0b9be8908cd2","Type":"ContainerStarted","Data":"c4196215e9f12edee33c5cca54f14ec6f7caa0fb463b2c94089dc3790689b1a0"}
Jul 08 09:36:27.131586 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:27.131539    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" podStartSLOduration=1.131524589 podStartE2EDuration="1.131524589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:36:27.130346567 +0000 UTC m=+1763.640120312" watchObservedRunningTime="2026-07-08 09:36:27.131524589 +0000 UTC m=+1763.641298315"
Jul 08 09:36:29.198751 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:29.198717    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:36:36.419031 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:36.419002    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:36.419543 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:36.419068    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:36.431711 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:36.431689    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:37.168513 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:37.168479    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:36:48.688498 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:48.688451    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:36:58.430839 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:36:58.430761    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:37:04.016694 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:04.016664    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:37:04.019401 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:04.019378    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:37:04.020933 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:04.020913    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:37:04.023440 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:04.023418    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:37:05.482518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:05.482485    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:37:10.196531 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:10.196498    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:37:20.502247 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.502190    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" podUID="e1079895-9322-484d-a404-0b9be8908cd2" containerName="main" containerID="cri-o://261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e" gracePeriod=45
Jul 08 09:37:20.747763 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.747739    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:37:20.835677 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835600    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.835677 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835642    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.835876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835688    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.835876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835717    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.835876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835749    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.835876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835778    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtqb\" (UniqueName: \"kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb\") pod \"e1079895-9322-484d-a404-0b9be8908cd2\" (UID: \"e1079895-9322-484d-a404-0b9be8908cd2\") "
Jul 08 09:37:20.836116 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.835945    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache" (OuterVolumeSpecName: "model-cache") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:37:20.836178 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.836142    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:20.836305 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.836275    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:37:20.836305 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.836286    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home" (OuterVolumeSpecName: "home") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:37:20.837884 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.837859    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:37:20.838321 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.838305    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb" (OuterVolumeSpecName: "kube-api-access-6rtqb") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "kube-api-access-6rtqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:37:20.838372 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.838315    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm" (OuterVolumeSpecName: "dshm") pod "e1079895-9322-484d-a404-0b9be8908cd2" (UID: "e1079895-9322-484d-a404-0b9be8908cd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:37:20.936984 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.936961    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:20.936984 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.936985    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtqb\" (UniqueName: \"kubernetes.io/projected/e1079895-9322-484d-a404-0b9be8908cd2-kube-api-access-6rtqb\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:20.937119 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.936994    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1079895-9322-484d-a404-0b9be8908cd2-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:20.937119 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.937003    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:20.937119 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:20.937011    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1079895-9322-484d-a404-0b9be8908cd2-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:37:21.356464 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.356423    2547 generic.go:356] "Generic (PLEG): container finished" podID="e1079895-9322-484d-a404-0b9be8908cd2" containerID="261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e" exitCode=0
Jul 08 09:37:21.356647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.356482    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"
Jul 08 09:37:21.356647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.356498    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" event={"ID":"e1079895-9322-484d-a404-0b9be8908cd2","Type":"ContainerDied","Data":"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"}
Jul 08 09:37:21.356647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.356523    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq" event={"ID":"e1079895-9322-484d-a404-0b9be8908cd2","Type":"ContainerDied","Data":"c4196215e9f12edee33c5cca54f14ec6f7caa0fb463b2c94089dc3790689b1a0"}
Jul 08 09:37:21.356647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.356539    2547 scope.go:117] "RemoveContainer" containerID="261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"
Jul 08 09:37:21.371599 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.371563    2547 scope.go:117] "RemoveContainer" containerID="261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"
Jul 08 09:37:21.372147 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:37:21.372114    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e\": container with ID starting with 261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e not found: ID does not exist" containerID="261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"
Jul 08 09:37:21.372260 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.372157    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e"} err="failed to get container status \"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e\": rpc error: code = NotFound desc = could not find container \"261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e\": container with ID starting with 261769e3d83a00c541b553bd66279fa4f2b85e3a4f6be83d32c1ab7404aa950e not found: ID does not exist"
Jul 08 09:37:21.384601 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.384568    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:37:21.388705 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:21.388682    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0775092a/e2e-lifecycle-model-0775092a-kserve-fc74ff68c-swrhq"]
Jul 08 09:37:22.034059 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:22.034027    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1079895-9322-484d-a404-0b9be8908cd2" path="/var/lib/kubelet/pods/e1079895-9322-484d-a404-0b9be8908cd2/volumes"
Jul 08 09:37:44.891612 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:44.891574    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:37:53.698618 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:37:53.698585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:38:08.119774 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:38:08.119741    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:38:56.090863 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:38:56.090828    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:39:08.187497 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:08.187450    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:39:14.718997 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.718954    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:39:14.719823 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.719798    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1079895-9322-484d-a404-0b9be8908cd2" containerName="main"
Jul 08 09:39:14.719920 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.719827    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1079895-9322-484d-a404-0b9be8908cd2" containerName="main"
Jul 08 09:39:14.720016 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.720004    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1079895-9322-484d-a404-0b9be8908cd2" containerName="main"
Jul 08 09:39:14.723867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.723840    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.728697 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.728677    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ec6b4\"/\"default-dockercfg-s2mwt\""
Jul 08 09:39:14.728873 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.728854    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ec6b4\"/\"test-model-2ec6b4-kserve-self-signed-certs\""
Jul 08 09:39:14.728953 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.728914    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ec6b4\"/\"openshift-service-ca.crt\""
Jul 08 09:39:14.728953 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.728938    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ec6b4\"/\"kube-root-ca.crt\""
Jul 08 09:39:14.733813 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.733790    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:39:14.855667 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855637    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.855667 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855667    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.855870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855689    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.855870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855720    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.855870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.855870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.855832    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx49x\" (UniqueName: \"kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957027 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.956994    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957027 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957032    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx49x\" (UniqueName: \"kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957051    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957069    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957144    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957192    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957500 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957450    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957548 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957498    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.957583 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.957542    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.959552 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.959520    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.959671 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.959655    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:14.967613 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:14.967591    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx49x\" (UniqueName: \"kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x\") pod \"test-model-2ec6b4-kserve-567fc96c5c-499vr\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") " pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:15.034715 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:15.034637    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:15.169319 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:15.169292    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:39:15.171243 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:39:15.171213    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6d66a93_5daa_47ee_b5ce_430dd70541fb.slice/crio-2661f43a1cf7f3432131473de577dcbedd510ec43b1174e8c7815722e654c2e4 WatchSource:0}: Error finding container 2661f43a1cf7f3432131473de577dcbedd510ec43b1174e8c7815722e654c2e4: Status 404 returned error can't find the container with id 2661f43a1cf7f3432131473de577dcbedd510ec43b1174e8c7815722e654c2e4
Jul 08 09:39:15.884224 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:15.884186    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" event={"ID":"c6d66a93-5daa-47ee-b5ce-430dd70541fb","Type":"ContainerStarted","Data":"15d0e1937843007d44587bf10dbfa0531aaebd8a1715e3301dbeb8d6bdf525a0"}
Jul 08 09:39:15.884224 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:15.884232    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" event={"ID":"c6d66a93-5daa-47ee-b5ce-430dd70541fb","Type":"ContainerStarted","Data":"2661f43a1cf7f3432131473de577dcbedd510ec43b1174e8c7815722e654c2e4"}
Jul 08 09:39:15.904473 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:15.904403    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" podStartSLOduration=1.9043882509999999 podStartE2EDuration="1.904388251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:39:15.90177618 +0000 UTC m=+1932.411549907" watchObservedRunningTime="2026-07-08 09:39:15.904388251 +0000 UTC m=+1932.414161977"
Jul 08 09:39:21.385779 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:21.385741    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:39:25.035053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:25.035014    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:25.035581 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:25.035092    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:25.047348 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:25.047321    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:25.941596 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:25.941567    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:39:49.392618 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.392581    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:39:49.396098 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.396079    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.399011 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.398991    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-802008\"/\"test-model-802008-kserve-self-signed-certs\""
Jul 08 09:39:49.399011 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.399006    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-802008\"/\"openshift-service-ca.crt\""
Jul 08 09:39:49.400123 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.400103    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-802008\"/\"default-dockercfg-rkkff\""
Jul 08 09:39:49.400233 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.400139    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-802008\"/\"kube-root-ca.crt\""
Jul 08 09:39:49.411657 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.411635    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:39:49.451411 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.451564 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451429    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.451564 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451539    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw27n\" (UniqueName: \"kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.451684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451571    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.451684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451666    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.451771 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.451692    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552595 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552563    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552606    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw27n\" (UniqueName: \"kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552634    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552699    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552752 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552724    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.552965 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.552779    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.553093 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.553072    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.553150 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.553096    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.553150 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.553126    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.554893 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.554875    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.555158 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.555139    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.561427 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.561400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw27n\" (UniqueName: \"kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n\") pod \"test-model-802008-kserve-757b5b68d9-4gg5x\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") " pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.706278 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.706206    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:49.837831 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:49.837808    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:39:49.839986 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:39:49.839963    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73155d0a_152d_4ef7_a482_8428593c50bd.slice/crio-a40459c9087c68c3a60a4794b2017f82a7c526e79f1a325a5902eee289ac323f WatchSource:0}: Error finding container a40459c9087c68c3a60a4794b2017f82a7c526e79f1a325a5902eee289ac323f: Status 404 returned error can't find the container with id a40459c9087c68c3a60a4794b2017f82a7c526e79f1a325a5902eee289ac323f
Jul 08 09:39:50.045698 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:50.045605    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" event={"ID":"73155d0a-152d-4ef7-a482-8428593c50bd","Type":"ContainerStarted","Data":"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"}
Jul 08 09:39:50.045698 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:50.045651    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" event={"ID":"73155d0a-152d-4ef7-a482-8428593c50bd","Type":"ContainerStarted","Data":"a40459c9087c68c3a60a4794b2017f82a7c526e79f1a325a5902eee289ac323f"}
Jul 08 09:39:50.067963 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:50.067917    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" podStartSLOduration=1.06790274 podStartE2EDuration="1.06790274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:39:50.065222239 +0000 UTC m=+1966.574995979" watchObservedRunningTime="2026-07-08 09:39:50.06790274 +0000 UTC m=+1966.577676466"
Jul 08 09:39:53.402024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:53.401994    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:39:59.707392 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:59.707307    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:59.707392 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:59.707361    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:39:59.719921 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:39:59.719898    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:40:00.103108 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:00.103028    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:40:09.683686 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:09.683653    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:40:10.961980 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:10.961947    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:40:11.826219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:11.826188    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:40:23.397619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:23.397583    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:40:25.981543 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:25.981502    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" podUID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" containerName="main" containerID="cri-o://15d0e1937843007d44587bf10dbfa0531aaebd8a1715e3301dbeb8d6bdf525a0" gracePeriod=45
Jul 08 09:40:26.211316 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.211281    2547 generic.go:356] "Generic (PLEG): container finished" podID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" containerID="15d0e1937843007d44587bf10dbfa0531aaebd8a1715e3301dbeb8d6bdf525a0" exitCode=0
Jul 08 09:40:26.211486 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.211325    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" event={"ID":"c6d66a93-5daa-47ee-b5ce-430dd70541fb","Type":"ContainerDied","Data":"15d0e1937843007d44587bf10dbfa0531aaebd8a1715e3301dbeb8d6bdf525a0"}
Jul 08 09:40:26.238274 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.238216    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:40:26.375383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375352    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375577 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375413    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375577 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375433    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375577 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375501    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375577 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375527    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375577 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375546    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx49x\" (UniqueName: \"kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x\") pod \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\" (UID: \"c6d66a93-5daa-47ee-b5ce-430dd70541fb\") "
Jul 08 09:40:26.375850 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375665    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:26.375850 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375675    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home" (OuterVolumeSpecName: "home") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:26.375953 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375855    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.375953 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375871    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.375953 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.375862    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:26.377865 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.377841    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm" (OuterVolumeSpecName: "dshm") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:26.377961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.377860    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x" (OuterVolumeSpecName: "kube-api-access-vx49x") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "kube-api-access-vx49x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:40:26.377961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.377848    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6d66a93-5daa-47ee-b5ce-430dd70541fb" (UID: "c6d66a93-5daa-47ee-b5ce-430dd70541fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:40:26.476684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.476662    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6d66a93-5daa-47ee-b5ce-430dd70541fb-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.476684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.476684    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.476684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.476692    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6d66a93-5daa-47ee-b5ce-430dd70541fb-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.476867 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.476700    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx49x\" (UniqueName: \"kubernetes.io/projected/c6d66a93-5daa-47ee-b5ce-430dd70541fb-kube-api-access-vx49x\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:26.845696 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:26.845657    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" podUID="73155d0a-152d-4ef7-a482-8428593c50bd" containerName="main" containerID="cri-o://8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025" gracePeriod=45
Jul 08 09:40:27.090613 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.090587    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:40:27.217601 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.217570    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"
Jul 08 09:40:27.217601 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.217589    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr" event={"ID":"c6d66a93-5daa-47ee-b5ce-430dd70541fb","Type":"ContainerDied","Data":"2661f43a1cf7f3432131473de577dcbedd510ec43b1174e8c7815722e654c2e4"}
Jul 08 09:40:27.217829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.217642    2547 scope.go:117] "RemoveContainer" containerID="15d0e1937843007d44587bf10dbfa0531aaebd8a1715e3301dbeb8d6bdf525a0"
Jul 08 09:40:27.218927 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.218904    2547 generic.go:356] "Generic (PLEG): container finished" podID="73155d0a-152d-4ef7-a482-8428593c50bd" containerID="8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025" exitCode=0
Jul 08 09:40:27.219053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.218951    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"
Jul 08 09:40:27.219053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.218992    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" event={"ID":"73155d0a-152d-4ef7-a482-8428593c50bd","Type":"ContainerDied","Data":"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"}
Jul 08 09:40:27.219053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.219040    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x" event={"ID":"73155d0a-152d-4ef7-a482-8428593c50bd","Type":"ContainerDied","Data":"a40459c9087c68c3a60a4794b2017f82a7c526e79f1a325a5902eee289ac323f"}
Jul 08 09:40:27.226899 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.226883    2547 scope.go:117] "RemoveContainer" containerID="8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"
Jul 08 09:40:27.234162 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.234145    2547 scope.go:117] "RemoveContainer" containerID="8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"
Jul 08 09:40:27.234400 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:40:27.234384    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025\": container with ID starting with 8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025 not found: ID does not exist" containerID="8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"
Jul 08 09:40:27.234450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.234407    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025"} err="failed to get container status \"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025\": rpc error: code = NotFound desc = could not find container \"8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025\": container with ID starting with 8b46c31c2e9dc97565980dcb975475af105dc00b406665a0e83ae50c3fa64025 not found: ID does not exist"
Jul 08 09:40:27.241267 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.241244    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:40:27.245708 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.245689    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2ec6b4/test-model-2ec6b4-kserve-567fc96c5c-499vr"]
Jul 08 09:40:27.282282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282265    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282381 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282307    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw27n\" (UniqueName: \"kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282381 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282343    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282451 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282385    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282451 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282431    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282583 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282487    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm\") pod \"73155d0a-152d-4ef7-a482-8428593c50bd\" (UID: \"73155d0a-152d-4ef7-a482-8428593c50bd\") "
Jul 08 09:40:27.282641 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282576    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:27.282704 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282680    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home" (OuterVolumeSpecName: "home") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:27.282794 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282772    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:27.282854 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282767    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.282854 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.282826    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.284539 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.284519    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm" (OuterVolumeSpecName: "dshm") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:40:27.284614 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.284534    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:40:27.284614 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.284524    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n" (OuterVolumeSpecName: "kube-api-access-bw27n") pod "73155d0a-152d-4ef7-a482-8428593c50bd" (UID: "73155d0a-152d-4ef7-a482-8428593c50bd"). InnerVolumeSpecName "kube-api-access-bw27n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:40:27.383518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.383496    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw27n\" (UniqueName: \"kubernetes.io/projected/73155d0a-152d-4ef7-a482-8428593c50bd-kube-api-access-bw27n\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.383518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.383517    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73155d0a-152d-4ef7-a482-8428593c50bd-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.383640 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.383526    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.383640 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.383535    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73155d0a-152d-4ef7-a482-8428593c50bd-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:40:27.542298 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.542273    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:40:27.547408 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:27.547387    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-802008/test-model-802008-kserve-757b5b68d9-4gg5x"]
Jul 08 09:40:28.034393 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:28.034360    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73155d0a-152d-4ef7-a482-8428593c50bd" path="/var/lib/kubelet/pods/73155d0a-152d-4ef7-a482-8428593c50bd/volumes"
Jul 08 09:40:28.034777 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:28.034762    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" path="/var/lib/kubelet/pods/c6d66a93-5daa-47ee-b5ce-430dd70541fb/volumes"
Jul 08 09:40:58.801866 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:40:58.801830    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:41:11.709390 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:41:11.709355    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:41:22.472777 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:41:22.472742    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:41:33.908617 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:41:33.908528    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:41:45.196975 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:41:45.196933    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:41:56.597896 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:41:56.597854    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:42:04.043619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:04.043591    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:42:04.047472 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:04.047438    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:42:04.047619 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:04.047594    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:42:04.051759 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:04.051736    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:42:13.516936 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.516902    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517223    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73155d0a-152d-4ef7-a482-8428593c50bd" containerName="main"
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517234    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="73155d0a-152d-4ef7-a482-8428593c50bd" containerName="main"
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517254    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" containerName="main"
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517259    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" containerName="main"
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517311    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d66a93-5daa-47ee-b5ce-430dd70541fb" containerName="main"
Jul 08 09:42:13.517410 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.517321    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="73155d0a-152d-4ef7-a482-8428593c50bd" containerName="main"
Jul 08 09:42:13.520225 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.520209    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.526872 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.526853    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"kube-root-ca.crt\""
Jul 08 09:42:13.527888 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.527868    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"auth-test-model-8c4427-kserve-self-signed-certs\""
Jul 08 09:42:13.527994 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.527888    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"openshift-service-ca.crt\""
Jul 08 09:42:13.528056 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.528012    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"default-dockercfg-4fqks\""
Jul 08 09:42:13.534235 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.534209    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:42:13.645535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.645535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645528    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.645535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645555    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.645842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645605    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.645842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645645    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525nr\" (UniqueName: \"kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.645842 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.645691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747196 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747151    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747196 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747198    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747262    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525nr\" (UniqueName: \"kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747450 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747329    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747822 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747797    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747831    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.747922 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.747902    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.749621 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.749590    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.749748 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.749732    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.766647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.766619    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-525nr\" (UniqueName: \"kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr\") pod \"auth-test-model-8c4427-kserve-6fdbb68459-gzpt9\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") " pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.828917 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.828833    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:13.962106 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:13.962079    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:42:13.963958 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:42:13.963932    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f495f87_a402_4330_a8fe_cb81247423a8.slice/crio-b240026846a4b229201a57979971b74d6a6b8254e7994cd27a034babf1c404f6 WatchSource:0}: Error finding container b240026846a4b229201a57979971b74d6a6b8254e7994cd27a034babf1c404f6: Status 404 returned error can't find the container with id b240026846a4b229201a57979971b74d6a6b8254e7994cd27a034babf1c404f6
Jul 08 09:42:14.705685 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:14.705643    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" event={"ID":"6f495f87-a402-4330-a8fe-cb81247423a8","Type":"ContainerStarted","Data":"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"}
Jul 08 09:42:14.706053 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:14.705695    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" event={"ID":"6f495f87-a402-4330-a8fe-cb81247423a8","Type":"ContainerStarted","Data":"b240026846a4b229201a57979971b74d6a6b8254e7994cd27a034babf1c404f6"}
Jul 08 09:42:14.727413 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:14.727352    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" podStartSLOduration=1.727336834 podStartE2EDuration="1.727336834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:42:14.726922359 +0000 UTC m=+2111.236696106" watchObservedRunningTime="2026-07-08 09:42:14.727336834 +0000 UTC m=+2111.237110560"
Jul 08 09:42:17.103489 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:17.103438    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:42:23.829205 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:23.829166    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:23.829751 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:23.829236    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:23.842657 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:23.842630    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:24.763591 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:24.763560    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:42:37.304055 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.304013    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:42:37.307706 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.307683    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.311697 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.311674    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"auth-test-model-f0ff0b-kserve-self-signed-certs\""
Jul 08 09:42:37.313094 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.313071    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"openshift-service-ca.crt\""
Jul 08 09:42:37.313238 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.313095    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"default-dockercfg-255lk\""
Jul 08 09:42:37.313238 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.313080    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"kube-root-ca.crt\""
Jul 08 09:42:37.323824 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.323800    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:42:37.361988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.361953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.361988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.361993    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.362342 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.362013    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.362342 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.362043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2tbb\" (UniqueName: \"kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.362342 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.362092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.362342 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.362189    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463513 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463476    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463513 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463514    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463764 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463533    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463764 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463558    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2tbb\" (UniqueName: \"kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463764 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463595    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.463764 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463636    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.464022 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.463998    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.464022 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.464014    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.464145 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.464074    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.465892 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.465870    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.466062 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.466045    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.478483 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.478438    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2tbb\" (UniqueName: \"kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb\") pod \"auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") " pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.617647 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.617554    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:37.756320 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.756295    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:42:37.758240 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:42:37.758200    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a13e43d_9d28_4682_88a5_ef71bd5e3bfc.slice/crio-c0061f3fce1cba28094ceafab6951dc6f3a6ef66ad5754fa3209a41088f38fe3 WatchSource:0}: Error finding container c0061f3fce1cba28094ceafab6951dc6f3a6ef66ad5754fa3209a41088f38fe3: Status 404 returned error can't find the container with id c0061f3fce1cba28094ceafab6951dc6f3a6ef66ad5754fa3209a41088f38fe3
Jul 08 09:42:37.821771 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:37.821738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" event={"ID":"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc","Type":"ContainerStarted","Data":"c0061f3fce1cba28094ceafab6951dc6f3a6ef66ad5754fa3209a41088f38fe3"}
Jul 08 09:42:38.827978 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:38.827943    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" event={"ID":"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc","Type":"ContainerStarted","Data":"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"}
Jul 08 09:42:38.852848 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:38.852785    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" podStartSLOduration=1.852763079 podStartE2EDuration="1.852763079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:42:38.850683066 +0000 UTC m=+2135.360456812" watchObservedRunningTime="2026-07-08 09:42:38.852763079 +0000 UTC m=+2135.362536805"
Jul 08 09:42:40.630226 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:40.630189    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:42:47.618564 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:47.618517    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:47.621043 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:47.618580    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:47.631085 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:47.631059    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:42:47.883961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:42:47.883881    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:43:02.100849 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:43:02.100763    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:43:16.690981 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:43:16.690947    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:43:31.148625 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:43:31.148589    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:43:48.715060 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:43:48.715026    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:44:06.200406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:06.200370    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:44:23.803601 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:23.803570    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:44:39.312698 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:39.312613    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:44:42.526776 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:42.526742    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:44:43.585872 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:43.585836    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:44:50.831598 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.831567    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:44:50.834646 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.834630    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.839126 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.839106    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"sub-test-model-8c4427-kserve-self-signed-certs\""
Jul 08 09:44:50.871760 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.871732    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:44:50.932799 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932766    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.932799 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932805    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lck5\" (UniqueName: \"kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.932988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932840    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.932988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932907    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.932988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932942    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:50.932988 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:50.932978    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.033667 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.033629    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.033848 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.033677    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lck5\" (UniqueName: \"kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.033915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.033880    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.033971 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.033944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.034031 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.033985    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.034031 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.034012    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.034169 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.034148    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.034248 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.034229    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.034351 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.034337    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.036225 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.036198    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.036518 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.036499    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.046653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.046632    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lck5\" (UniqueName: \"kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5\") pod \"sub-test-model-8c4427-kserve-75c76dbb67-pbk6c\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") " pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.143830 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.143795    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:44:51.305768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.305740    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:44:51.308365 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:44:51.308330    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8413d963_bac0_4b46_b5b7_b2dc7adb5d10.slice/crio-17f590f3c0629394f607ecc50229042d9516c36d12cbda18c720c703f7e5dd10 WatchSource:0}: Error finding container 17f590f3c0629394f607ecc50229042d9516c36d12cbda18c720c703f7e5dd10: Status 404 returned error can't find the container with id 17f590f3c0629394f607ecc50229042d9516c36d12cbda18c720c703f7e5dd10
Jul 08 09:44:51.455782 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.455703    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" event={"ID":"8413d963-bac0-4b46-b5b7-b2dc7adb5d10","Type":"ContainerStarted","Data":"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"}
Jul 08 09:44:51.455782 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.455745    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" event={"ID":"8413d963-bac0-4b46-b5b7-b2dc7adb5d10","Type":"ContainerStarted","Data":"17f590f3c0629394f607ecc50229042d9516c36d12cbda18c720c703f7e5dd10"}
Jul 08 09:44:51.494657 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:51.494603    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" podStartSLOduration=1.494590158 podStartE2EDuration="1.494590158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:44:51.492945946 +0000 UTC m=+2268.002719692" watchObservedRunningTime="2026-07-08 09:44:51.494590158 +0000 UTC m=+2268.004363884"
Jul 08 09:44:55.346743 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:55.346704    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:44:57.546736 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.546696    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" podUID="6f495f87-a402-4330-a8fe-cb81247423a8" containerName="main" containerID="cri-o://8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856" gracePeriod=45
Jul 08 09:44:57.798646 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.798582    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:44:57.899605 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899574    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.899800 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899622    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.899800 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899664    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.899800 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899703    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.899800 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899736    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.899800 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899759    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-525nr\" (UniqueName: \"kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr\") pod \"6f495f87-a402-4330-a8fe-cb81247423a8\" (UID: \"6f495f87-a402-4330-a8fe-cb81247423a8\") "
Jul 08 09:44:57.900019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899872    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:57.900019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899896    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home" (OuterVolumeSpecName: "home") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:57.900019 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.899990    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:57.900162 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.900143    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:57.900202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.900166    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:57.900202 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.900174    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:57.902062 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.902036    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm" (OuterVolumeSpecName: "dshm") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:57.902177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.902040    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:44:57.902177 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:57.902097    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr" (OuterVolumeSpecName: "kube-api-access-525nr") pod "6f495f87-a402-4330-a8fe-cb81247423a8" (UID: "6f495f87-a402-4330-a8fe-cb81247423a8"). InnerVolumeSpecName "kube-api-access-525nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:44:58.001008 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.000973    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f495f87-a402-4330-a8fe-cb81247423a8-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:58.001008 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.001000    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f495f87-a402-4330-a8fe-cb81247423a8-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:58.001008 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.001011    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-525nr\" (UniqueName: \"kubernetes.io/projected/6f495f87-a402-4330-a8fe-cb81247423a8-kube-api-access-525nr\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:58.490903 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.490864    2547 generic.go:356] "Generic (PLEG): container finished" podID="6f495f87-a402-4330-a8fe-cb81247423a8" containerID="8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856" exitCode=0
Jul 08 09:44:58.491083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.490912    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"
Jul 08 09:44:58.491083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.490942    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" event={"ID":"6f495f87-a402-4330-a8fe-cb81247423a8","Type":"ContainerDied","Data":"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"}
Jul 08 09:44:58.491083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.490990    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9" event={"ID":"6f495f87-a402-4330-a8fe-cb81247423a8","Type":"ContainerDied","Data":"b240026846a4b229201a57979971b74d6a6b8254e7994cd27a034babf1c404f6"}
Jul 08 09:44:58.491083 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.491007    2547 scope.go:117] "RemoveContainer" containerID="8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"
Jul 08 09:44:58.499247 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.499227    2547 scope.go:117] "RemoveContainer" containerID="8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"
Jul 08 09:44:58.499540 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:44:58.499517    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856\": container with ID starting with 8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856 not found: ID does not exist" containerID="8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"
Jul 08 09:44:58.499625 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.499548    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856"} err="failed to get container status \"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856\": rpc error: code = NotFound desc = could not find container \"8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856\": container with ID starting with 8158fe8ca42106da1f42a3a84c902b59504502e0baf251c4474707f781be9856 not found: ID does not exist"
Jul 08 09:44:58.514746 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.514724    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:44:58.520302 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.520280    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/auth-test-model-8c4427-kserve-6fdbb68459-gzpt9"]
Jul 08 09:44:58.605934 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.605898    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" podUID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" containerName="main" containerID="cri-o://a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32" gracePeriod=45
Jul 08 09:44:58.865276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:58.865254    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:44:59.009706 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009667    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2tbb\" (UniqueName: \"kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.009871 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009824    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.009871 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009857    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.009960 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009888    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.009960 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009938    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.010066 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.009965    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache\") pod \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\" (UID: \"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc\") "
Jul 08 09:44:59.010120 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.010086    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:59.010189 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.010171    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home" (OuterVolumeSpecName: "home") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:59.010304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.010281    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.010304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.010293    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.010304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.010289    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:59.012001 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.011976    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm" (OuterVolumeSpecName: "dshm") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:44:59.012100 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.012027    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:44:59.012100 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.012057    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb" (OuterVolumeSpecName: "kube-api-access-k2tbb") pod "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" (UID: "2a13e43d-9d28-4682-88a5-ef71bd5e3bfc"). InnerVolumeSpecName "kube-api-access-k2tbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:44:59.111805 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.111721    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.111805 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.111749    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.111805 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.111759    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.111805 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.111770    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2tbb\" (UniqueName: \"kubernetes.io/projected/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc-kube-api-access-k2tbb\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:44:59.496775 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.496741    2547 generic.go:356] "Generic (PLEG): container finished" podID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" containerID="a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32" exitCode=0
Jul 08 09:44:59.496961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.496795    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"
Jul 08 09:44:59.496961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.496822    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" event={"ID":"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc","Type":"ContainerDied","Data":"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"}
Jul 08 09:44:59.496961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.496866    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn" event={"ID":"2a13e43d-9d28-4682-88a5-ef71bd5e3bfc","Type":"ContainerDied","Data":"c0061f3fce1cba28094ceafab6951dc6f3a6ef66ad5754fa3209a41088f38fe3"}
Jul 08 09:44:59.496961 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.496883    2547 scope.go:117] "RemoveContainer" containerID="a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"
Jul 08 09:44:59.506131 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.506112    2547 scope.go:117] "RemoveContainer" containerID="a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"
Jul 08 09:44:59.506368 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:44:59.506350    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32\": container with ID starting with a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32 not found: ID does not exist" containerID="a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"
Jul 08 09:44:59.506431 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.506374    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32"} err="failed to get container status \"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32\": rpc error: code = NotFound desc = could not find container \"a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32\": container with ID starting with a4aa2df5404af0ebea831216183db265e31ed3ebf45c1ac64eac92eff1160c32 not found: ID does not exist"
Jul 08 09:44:59.526524 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.526484    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:44:59.542377 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:44:59.537409    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/auth-test-model-f0ff0b-kserve-b8c6db579-rf4tn"]
Jul 08 09:45:00.034943 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:00.034909    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" path="/var/lib/kubelet/pods/2a13e43d-9d28-4682-88a5-ef71bd5e3bfc/volumes"
Jul 08 09:45:00.035311 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:00.035278    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f495f87-a402-4330-a8fe-cb81247423a8" path="/var/lib/kubelet/pods/6f495f87-a402-4330-a8fe-cb81247423a8/volumes"
Jul 08 09:45:01.144314 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:01.144283    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:45:01.144751 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:01.144330    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:45:01.156744 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:01.156722    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:45:01.519153 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:01.519069    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:45:15.903947 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.903914    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:45:15.904338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904237    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" containerName="main"
Jul 08 09:45:15.904338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904248    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" containerName="main"
Jul 08 09:45:15.904338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904263    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f495f87-a402-4330-a8fe-cb81247423a8" containerName="main"
Jul 08 09:45:15.904338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904268    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f495f87-a402-4330-a8fe-cb81247423a8" containerName="main"
Jul 08 09:45:15.904338 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904330    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a13e43d-9d28-4682-88a5-ef71bd5e3bfc" containerName="main"
Jul 08 09:45:15.904531 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.904342    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f495f87-a402-4330-a8fe-cb81247423a8" containerName="main"
Jul 08 09:45:15.907103 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.907086    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.911353 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.911326    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"openshift-service-ca.crt\""
Jul 08 09:45:15.911506 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.911395    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"default-dockercfg-255lk\""
Jul 08 09:45:15.912712 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.912682    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"sub-test-model-f0ff0b-kserve-self-signed-certs\""
Jul 08 09:45:15.912712 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.912701    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"kube-root-ca.crt\""
Jul 08 09:45:15.921490 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.921450    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:45:15.947890 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.947864    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.948000 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.947894    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.948000 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.947914    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.948000 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.947945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8qd5\" (UniqueName: \"kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.948161 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.948029    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:15.948161 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:15.948068    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049091 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049239 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049114    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049239 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049226    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049350 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049260    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049350 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049302    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8qd5\" (UniqueName: \"kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049483 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049358    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049483 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049441    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049617 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049597    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.049680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.049666    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.051400 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.051374    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.051698 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.051677    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.062682 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.062661    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8qd5\" (UniqueName: \"kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5\") pod \"sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") " pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.219377 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.219310    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:16.354777 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.354754    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:45:16.355744 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:45:16.355722    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9daa792_2355_4ade_9a04_91b749c36615.slice/crio-290dd9b66579750a99eebcc44b97f9495d44a1e85b9ec071451b6b7a282e946d WatchSource:0}: Error finding container 290dd9b66579750a99eebcc44b97f9495d44a1e85b9ec071451b6b7a282e946d: Status 404 returned error can't find the container with id 290dd9b66579750a99eebcc44b97f9495d44a1e85b9ec071451b6b7a282e946d
Jul 08 09:45:16.578662 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.578574    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" event={"ID":"e9daa792-2355-4ade-9a04-91b749c36615","Type":"ContainerStarted","Data":"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"}
Jul 08 09:45:16.578662 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.578613    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" event={"ID":"e9daa792-2355-4ade-9a04-91b749c36615","Type":"ContainerStarted","Data":"290dd9b66579750a99eebcc44b97f9495d44a1e85b9ec071451b6b7a282e946d"}
Jul 08 09:45:16.600259 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:16.600209    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" podStartSLOduration=1.600190429 podStartE2EDuration="1.600190429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:45:16.597436692 +0000 UTC m=+2293.107210418" watchObservedRunningTime="2026-07-08 09:45:16.600190429 +0000 UTC m=+2293.109964156"
Jul 08 09:45:20.321626 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:20.321585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:45:26.220304 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:26.220272    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:26.220839 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:26.220329    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:26.232816 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:26.232792    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:26.635535 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:26.635425    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:45:38.006903 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:38.006865    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:45:56.393999 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:45:56.393910    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:46:01.324451 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:01.324415    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:46:02.240991 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:02.240955    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:46:11.411819 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.411781    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:46:11.415276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.415251    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.418130 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.418102    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c4427\"/\"rate-test-model-8c4427-kserve-self-signed-certs\""
Jul 08 09:46:11.425887 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.425864    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:46:11.528225 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.528406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528256    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.528406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528282    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855hp\" (UniqueName: \"kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.528406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528304    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.528406 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528376    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.528617 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.528411    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.628849 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628811    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628876    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628896    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855hp\" (UniqueName: \"kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628917    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628957    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629052 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.628999    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629402 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.629365    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.629408    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.629563 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.629442    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.631231 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.631210    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.631331 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.631288    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.637251 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.637229    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-855hp\" (UniqueName: \"kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp\") pod \"rate-test-model-8c4427-kserve-77c8d556f9-968hx\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") " pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.725059 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.724967    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:11.861156 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:11.861134    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:46:11.863108 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:46:11.863065    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92b27b89_4d65_4138_b35f_64bdfc581b8c.slice/crio-33420b29dd4a46a3b067adb9dcfcfdb7f063f8b06d0d3d58196f2f0dad1f7ffc WatchSource:0}: Error finding container 33420b29dd4a46a3b067adb9dcfcfdb7f063f8b06d0d3d58196f2f0dad1f7ffc: Status 404 returned error can't find the container with id 33420b29dd4a46a3b067adb9dcfcfdb7f063f8b06d0d3d58196f2f0dad1f7ffc
Jul 08 09:46:12.838306 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:12.838274    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" event={"ID":"92b27b89-4d65-4138-b35f-64bdfc581b8c","Type":"ContainerStarted","Data":"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"}
Jul 08 09:46:12.838758 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:12.838317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" event={"ID":"92b27b89-4d65-4138-b35f-64bdfc581b8c","Type":"ContainerStarted","Data":"33420b29dd4a46a3b067adb9dcfcfdb7f063f8b06d0d3d58196f2f0dad1f7ffc"}
Jul 08 09:46:12.857307 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:12.857261    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" podStartSLOduration=1.857246735 podStartE2EDuration="1.857246735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:46:12.856322621 +0000 UTC m=+2349.366096349" watchObservedRunningTime="2026-07-08 09:46:12.857246735 +0000 UTC m=+2349.367020462"
Jul 08 09:46:14.093002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:14.092967    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:46:16.344408 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.344365    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" podUID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" containerName="main" containerID="cri-o://0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c" gracePeriod=45
Jul 08 09:46:16.601924 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.601861    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:46:16.673817 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.673785    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lck5\" (UniqueName: \"kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.673837    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.673869    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.673888    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.673907    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674002 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674003    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm\") pod \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\" (UID: \"8413d963-bac0-4b46-b5b7-b2dc7adb5d10\") "
Jul 08 09:46:16.674283 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674146    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home" (OuterVolumeSpecName: "home") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:16.674283 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674179    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:16.674283 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674220    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache" (OuterVolumeSpecName: "model-cache") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:16.674425 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674323    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.674425 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674336    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.674425 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.674345    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.676009 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.675989    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5" (OuterVolumeSpecName: "kube-api-access-9lck5") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "kube-api-access-9lck5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:46:16.676099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.676068    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:46:16.676099 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.676082    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm" (OuterVolumeSpecName: "dshm") pod "8413d963-bac0-4b46-b5b7-b2dc7adb5d10" (UID: "8413d963-bac0-4b46-b5b7-b2dc7adb5d10"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:16.775721 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.775678    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lck5\" (UniqueName: \"kubernetes.io/projected/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-kube-api-access-9lck5\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.775721 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.775715    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.775721 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.775724    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8413d963-bac0-4b46-b5b7-b2dc7adb5d10-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:16.862136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.862046    2547 generic.go:356] "Generic (PLEG): container finished" podID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" containerID="0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c" exitCode=0
Jul 08 09:46:16.862136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.862091    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" event={"ID":"8413d963-bac0-4b46-b5b7-b2dc7adb5d10","Type":"ContainerDied","Data":"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"}
Jul 08 09:46:16.862136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.862125    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c" event={"ID":"8413d963-bac0-4b46-b5b7-b2dc7adb5d10","Type":"ContainerDied","Data":"17f590f3c0629394f607ecc50229042d9516c36d12cbda18c720c703f7e5dd10"}
Jul 08 09:46:16.862416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.862149    2547 scope.go:117] "RemoveContainer" containerID="0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"
Jul 08 09:46:16.862416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.862094    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"
Jul 08 09:46:16.878715 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.878688    2547 scope.go:117] "RemoveContainer" containerID="0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"
Jul 08 09:46:16.879017 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:46:16.878995    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c\": container with ID starting with 0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c not found: ID does not exist" containerID="0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"
Jul 08 09:46:16.879082 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.879024    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c"} err="failed to get container status \"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c\": rpc error: code = NotFound desc = could not find container \"0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c\": container with ID starting with 0110c64819eb8f0470f8008dc09b6d746ed52d3b68c77265972b5b4718f6550c not found: ID does not exist"
Jul 08 09:46:16.891720 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.891691    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:46:16.898219 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:16.898197    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/sub-test-model-8c4427-kserve-75c76dbb67-pbk6c"]
Jul 08 09:46:17.260930 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.260868    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" podUID="e9daa792-2355-4ade-9a04-91b749c36615" containerName="main" containerID="cri-o://48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf" gracePeriod=45
Jul 08 09:46:17.510330 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.510303    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:46:17.581633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581544    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581596    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581633 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581632    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581655    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8qd5\" (UniqueName: \"kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581772    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581799    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir\") pod \"e9daa792-2355-4ade-9a04-91b749c36615\" (UID: \"e9daa792-2355-4ade-9a04-91b749c36615\") "
Jul 08 09:46:17.581915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581885    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:17.581915 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.581901    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home" (OuterVolumeSpecName: "home") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:17.582174 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.582101    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:17.582174 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.582119    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.582174 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.582132    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.583907 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.583876    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm" (OuterVolumeSpecName: "dshm") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:46:17.584024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.583925    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:46:17.584024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.584000    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5" (OuterVolumeSpecName: "kube-api-access-f8qd5") pod "e9daa792-2355-4ade-9a04-91b749c36615" (UID: "e9daa792-2355-4ade-9a04-91b749c36615"). InnerVolumeSpecName "kube-api-access-f8qd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:46:17.682901 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.682865    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.682901 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.682894    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8qd5\" (UniqueName: \"kubernetes.io/projected/e9daa792-2355-4ade-9a04-91b749c36615-kube-api-access-f8qd5\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.682901 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.682908    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9daa792-2355-4ade-9a04-91b749c36615-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.683137 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.682943    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9daa792-2355-4ade-9a04-91b749c36615-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:46:17.871063 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.870974    2547 generic.go:356] "Generic (PLEG): container finished" podID="e9daa792-2355-4ade-9a04-91b749c36615" containerID="48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf" exitCode=0
Jul 08 09:46:17.871063 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.871015    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"
Jul 08 09:46:17.871270 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.871061    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" event={"ID":"e9daa792-2355-4ade-9a04-91b749c36615","Type":"ContainerDied","Data":"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"}
Jul 08 09:46:17.871270 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.871102    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb" event={"ID":"e9daa792-2355-4ade-9a04-91b749c36615","Type":"ContainerDied","Data":"290dd9b66579750a99eebcc44b97f9495d44a1e85b9ec071451b6b7a282e946d"}
Jul 08 09:46:17.871270 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.871126    2547 scope.go:117] "RemoveContainer" containerID="48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"
Jul 08 09:46:17.879855 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.879835    2547 scope.go:117] "RemoveContainer" containerID="48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"
Jul 08 09:46:17.880097 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:46:17.880080    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf\": container with ID starting with 48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf not found: ID does not exist" containerID="48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"
Jul 08 09:46:17.880165 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.880111    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf"} err="failed to get container status \"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf\": rpc error: code = NotFound desc = could not find container \"48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf\": container with ID starting with 48e6200fb0d39dbba52b7c3dd3ab5fc9d21d394d159a28d58facff74663657bf not found: ID does not exist"
Jul 08 09:46:17.893258 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.893236    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:46:17.898011 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:17.897988    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/sub-test-model-f0ff0b-kserve-64977f4c8c-xcfwb"]
Jul 08 09:46:18.035586 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:18.035554    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" path="/var/lib/kubelet/pods/8413d963-bac0-4b46-b5b7-b2dc7adb5d10/volumes"
Jul 08 09:46:18.036046 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:18.036026    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9daa792-2355-4ade-9a04-91b749c36615" path="/var/lib/kubelet/pods/e9daa792-2355-4ade-9a04-91b749c36615/volumes"
Jul 08 09:46:21.725293 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:21.725259    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:21.725715 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:21.725307    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:21.737870 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:21.737844    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:46:21.903474 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:46:21.903429    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:47:00.300221 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300179    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300595    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9daa792-2355-4ade-9a04-91b749c36615" containerName="main"
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300609    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9daa792-2355-4ade-9a04-91b749c36615" containerName="main"
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300623    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" containerName="main"
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300628    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" containerName="main"
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300697    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8413d963-bac0-4b46-b5b7-b2dc7adb5d10" containerName="main"
Jul 08 09:47:00.300731 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.300707    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9daa792-2355-4ade-9a04-91b749c36615" containerName="main"
Jul 08 09:47:00.303849 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.303831    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.307070 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.307034    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"openshift-service-ca.crt\""
Jul 08 09:47:00.307224 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.307097    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"default-dockercfg-255lk\""
Jul 08 09:47:00.308355 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.308335    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"kube-root-ca.crt\""
Jul 08 09:47:00.308468 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.308437    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0ff0b\"/\"rate-test-model-f0ff0b-kserve-self-signed-certs\""
Jul 08 09:47:00.316582 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.316555    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:47:00.359585 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.359768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359608    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.359768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359641    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.359768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359661    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47nmh\" (UniqueName: \"kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.359768 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359680    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.359910 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.359792    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460567 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460515    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460567 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460567    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47nmh\" (UniqueName: \"kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460567 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460588    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460861 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460636    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460861 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460667    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.460861 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.460721    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.461027 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.461006    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.461027 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.461016    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.461141 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.461121    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.463076 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.463043    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.463354 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.463334    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.469738 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.469714    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47nmh\" (UniqueName: \"kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh\") pod \"rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") " pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.613586 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.613490    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:00.764876 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:00.764851    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:47:00.768019 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:47:00.767992    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75ee8b3a_4b25_4e88_8ebf_72e1d744a759.slice/crio-c888d855c52d1e757bdc3253ca9b4baf386ebb3cb1468c4a253868a72ab8ee2d WatchSource:0}: Error finding container c888d855c52d1e757bdc3253ca9b4baf386ebb3cb1468c4a253868a72ab8ee2d: Status 404 returned error can't find the container with id c888d855c52d1e757bdc3253ca9b4baf386ebb3cb1468c4a253868a72ab8ee2d
Jul 08 09:47:01.076901 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:01.076863    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" event={"ID":"75ee8b3a-4b25-4e88-8ebf-72e1d744a759","Type":"ContainerStarted","Data":"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"}
Jul 08 09:47:01.076901 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:01.076907    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" event={"ID":"75ee8b3a-4b25-4e88-8ebf-72e1d744a759","Type":"ContainerStarted","Data":"c888d855c52d1e757bdc3253ca9b4baf386ebb3cb1468c4a253868a72ab8ee2d"}
Jul 08 09:47:01.106812 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:01.106757    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" podStartSLOduration=1.106737574 podStartE2EDuration="1.106737574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:47:01.105018277 +0000 UTC m=+2397.614792022" watchObservedRunningTime="2026-07-08 09:47:01.106737574 +0000 UTC m=+2397.616511300"
Jul 08 09:47:03.992642 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:03.992600    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:47:04.073982 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:04.073951    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:47:04.078056 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:04.078030    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:47:04.078751 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:04.078728    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:47:04.082996 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:04.082976    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwrk6_7097b115-b2cd-474a-86d2-4b83f0a14cdf/ovn-acl-logging/0.log"
Jul 08 09:47:10.614080 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:10.614033    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:10.614671 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:10.614122    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:10.626745 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:10.626719    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:11.135773 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:11.135743    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:47:27.995940 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:27.995853    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:47:41.857813 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:41.857780    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:47:47.676610 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:47.676573    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:47:48.513682 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:48.513647    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:47:55.184192 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:47:55.184164    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:48:02.696757 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:02.696711    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" podUID="92b27b89-4d65-4138-b35f-64bdfc581b8c" containerName="main" containerID="cri-o://7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068" gracePeriod=45
Jul 08 09:48:02.944176 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:02.944148    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:48:03.035902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035804    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.035902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035856    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.035902 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035897    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.036195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035925    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-855hp\" (UniqueName: \"kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.036195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035944    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.036195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.035980    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm\") pod \"92b27b89-4d65-4138-b35f-64bdfc581b8c\" (UID: \"92b27b89-4d65-4138-b35f-64bdfc581b8c\") "
Jul 08 09:48:03.036195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036176    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.036383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036191    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home" (OuterVolumeSpecName: "home") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.036383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036204    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.036383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036278    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.036383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036300    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.036383 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.036313    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.038171 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.038141    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp" (OuterVolumeSpecName: "kube-api-access-855hp") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "kube-api-access-855hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:48:03.038303 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.038178    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm" (OuterVolumeSpecName: "dshm") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.038303 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.038181    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92b27b89-4d65-4138-b35f-64bdfc581b8c" (UID: "92b27b89-4d65-4138-b35f-64bdfc581b8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:48:03.137821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.137777    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92b27b89-4d65-4138-b35f-64bdfc581b8c-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.137821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.137806    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-855hp\" (UniqueName: \"kubernetes.io/projected/92b27b89-4d65-4138-b35f-64bdfc581b8c-kube-api-access-855hp\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.137821 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.137817    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92b27b89-4d65-4138-b35f-64bdfc581b8c-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.374974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.374885    2547 generic.go:356] "Generic (PLEG): container finished" podID="92b27b89-4d65-4138-b35f-64bdfc581b8c" containerID="7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068" exitCode=0
Jul 08 09:48:03.374974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.374923    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"
Jul 08 09:48:03.374974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.374927    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" event={"ID":"92b27b89-4d65-4138-b35f-64bdfc581b8c","Type":"ContainerDied","Data":"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"}
Jul 08 09:48:03.374974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.374956    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx" event={"ID":"92b27b89-4d65-4138-b35f-64bdfc581b8c","Type":"ContainerDied","Data":"33420b29dd4a46a3b067adb9dcfcfdb7f063f8b06d0d3d58196f2f0dad1f7ffc"}
Jul 08 09:48:03.374974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.374972    2547 scope.go:117] "RemoveContainer" containerID="7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"
Jul 08 09:48:03.384097 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.384077    2547 scope.go:117] "RemoveContainer" containerID="7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"
Jul 08 09:48:03.384384 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:48:03.384365    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068\": container with ID starting with 7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068 not found: ID does not exist" containerID="7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"
Jul 08 09:48:03.384427 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.384394    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068"} err="failed to get container status \"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068\": rpc error: code = NotFound desc = could not find container \"7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068\": container with ID starting with 7b2e456665fdfe5e0832c6ef50fd135e956a90d05c2f756a9b61b454fc4cb068 not found: ID does not exist"
Jul 08 09:48:03.413684 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.413653    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:48:03.415198 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.415176    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c4427/rate-test-model-8c4427-kserve-77c8d556f9-968hx"]
Jul 08 09:48:03.533263 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.533200    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" podUID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" containerName="main" containerID="cri-o://39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d" gracePeriod=45
Jul 08 09:48:03.792004 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.791978    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:48:03.945422 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945324    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945422 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945370    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945434    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945512    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945545    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945653 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945592    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47nmh\" (UniqueName: \"kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh\") pod \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\" (UID: \"75ee8b3a-4b25-4e88-8ebf-72e1d744a759\") "
Jul 08 09:48:03.945824 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945677    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache" (OuterVolumeSpecName: "model-cache") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.945824 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945683    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.945824 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945795    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home" (OuterVolumeSpecName: "home") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.945943 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945845    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-model-cache\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.945943 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.945856    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tmp-dir\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:03.947759 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.947730    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm" (OuterVolumeSpecName: "dshm") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 09:48:03.947855 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.947823    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh" (OuterVolumeSpecName: "kube-api-access-47nmh") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "kube-api-access-47nmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 09:48:03.947855 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:03.947841    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75ee8b3a-4b25-4e88-8ebf-72e1d744a759" (UID: "75ee8b3a-4b25-4e88-8ebf-72e1d744a759"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 09:48:04.035405 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.035372    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b27b89-4d65-4138-b35f-64bdfc581b8c" path="/var/lib/kubelet/pods/92b27b89-4d65-4138-b35f-64bdfc581b8c/volumes"
Jul 08 09:48:04.046829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.046806    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-tls-certs\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:04.046829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.046829    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-home\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:04.046970 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.046837    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-dshm\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:04.046970 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.046846    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47nmh\" (UniqueName: \"kubernetes.io/projected/75ee8b3a-4b25-4e88-8ebf-72e1d744a759-kube-api-access-47nmh\") on node \"ip-10-0-135-104.ec2.internal\" DevicePath \"\""
Jul 08 09:48:04.381919 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.381818    2547 generic.go:356] "Generic (PLEG): container finished" podID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" containerID="39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d" exitCode=0
Jul 08 09:48:04.381919 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.381876    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"
Jul 08 09:48:04.382136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.381879    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" event={"ID":"75ee8b3a-4b25-4e88-8ebf-72e1d744a759","Type":"ContainerDied","Data":"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"}
Jul 08 09:48:04.382136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.381998    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb" event={"ID":"75ee8b3a-4b25-4e88-8ebf-72e1d744a759","Type":"ContainerDied","Data":"c888d855c52d1e757bdc3253ca9b4baf386ebb3cb1468c4a253868a72ab8ee2d"}
Jul 08 09:48:04.382136 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.382024    2547 scope.go:117] "RemoveContainer" containerID="39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"
Jul 08 09:48:04.390592 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.390568    2547 scope.go:117] "RemoveContainer" containerID="39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"
Jul 08 09:48:04.390920 ip-10-0-135-104 kubenswrapper[2547]: E0708 09:48:04.390901    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d\": container with ID starting with 39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d not found: ID does not exist" containerID="39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"
Jul 08 09:48:04.390971 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.390931    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d"} err="failed to get container status \"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d\": rpc error: code = NotFound desc = could not find container \"39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d\": container with ID starting with 39b595caa9a51a681413a713db5f1aeefe16df40bd482aa258d46bc84480629d not found: ID does not exist"
Jul 08 09:48:04.407130 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.407088    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:48:04.410138 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:04.410108    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0ff0b/rate-test-model-f0ff0b-kserve-5bfb89f479-2qsvb"]
Jul 08 09:48:06.034903 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:06.034866    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" path="/var/lib/kubelet/pods/75ee8b3a-4b25-4e88-8ebf-72e1d744a759/volumes"
Jul 08 09:48:37.085148 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:37.085094    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts2dw"]
Jul 08 09:48:41.605424 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:41.605383    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c674bdc68-jtpwr_8f856ca0-b9bb-405b-8563-80f5fe02e0a1/authorino/0.log"
Jul 08 09:48:47.834125 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:47.834095    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d6485f98-vnm6p_d1e220c6-773f-4b14-bd99-a9607a8b21c5/copy-manifests/0.log"
Jul 08 09:48:47.843729 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:47.843693    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d6485f98-vnm6p_d1e220c6-773f-4b14-bd99-a9607a8b21c5/manager/0.log"
Jul 08 09:48:49.387039 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:49.386995    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c674bdc68-jtpwr_8f856ca0-b9bb-405b-8563-80f5fe02e0a1/authorino/0.log"
Jul 08 09:48:50.161093 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:50.161063    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ts2dw_45882c27-e14a-4456-8ed7-75ef33d763a7/limitador/0.log"
Jul 08 09:48:51.049175 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:51.049146    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5458fdb769-wfz7k_5a44171d-4e52-43ed-ab93-33d1a6c66a25/kube-auth-proxy/0.log"
Jul 08 09:48:52.453859 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:52.453830    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-g7bwf_48d7d88b-bf91-4016-ab09-0f5a3d4df70c/main/0.log"
Jul 08 09:48:52.580195 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:52.580167    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-s7w4m_fc59a00d-d63e-4dbd-9c7a-e576919e03fe/main/0.log"
Jul 08 09:48:57.419360 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419273    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-prsl4/must-gather-5vlkk"]
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419636    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b27b89-4d65-4138-b35f-64bdfc581b8c" containerName="main"
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419648    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b27b89-4d65-4138-b35f-64bdfc581b8c" containerName="main"
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419659    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" containerName="main"
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419664    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" containerName="main"
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419732    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b27b89-4d65-4138-b35f-64bdfc581b8c" containerName="main"
Jul 08 09:48:57.419811 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.419741    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ee8b3a-4b25-4e88-8ebf-72e1d744a759" containerName="main"
Jul 08 09:48:57.422829 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.422812    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.428404 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.428371    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-prsl4\"/\"default-dockercfg-6smtf\""
Jul 08 09:48:57.428802 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.428778    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-prsl4\"/\"openshift-service-ca.crt\""
Jul 08 09:48:57.428918 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.428832    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-prsl4\"/\"kube-root-ca.crt\""
Jul 08 09:48:57.435640 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.435612    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prsl4/must-gather-5vlkk"]
Jul 08 09:48:57.512214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.512173    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69ad6342-4ae7-4a72-858d-0ff9797bc77c-must-gather-output\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.512214 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.512218    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdml\" (UniqueName: \"kubernetes.io/projected/69ad6342-4ae7-4a72-858d-0ff9797bc77c-kube-api-access-ftdml\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.613571 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.613526    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69ad6342-4ae7-4a72-858d-0ff9797bc77c-must-gather-output\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.613571 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.613576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdml\" (UniqueName: \"kubernetes.io/projected/69ad6342-4ae7-4a72-858d-0ff9797bc77c-kube-api-access-ftdml\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.613925 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.613898    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69ad6342-4ae7-4a72-858d-0ff9797bc77c-must-gather-output\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.623166 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.623133    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdml\" (UniqueName: \"kubernetes.io/projected/69ad6342-4ae7-4a72-858d-0ff9797bc77c-kube-api-access-ftdml\") pod \"must-gather-5vlkk\" (UID: \"69ad6342-4ae7-4a72-858d-0ff9797bc77c\") " pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.731984 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.731901    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prsl4/must-gather-5vlkk"
Jul 08 09:48:57.876967 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.876890    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prsl4/must-gather-5vlkk"]
Jul 08 09:48:57.879859 ip-10-0-135-104 kubenswrapper[2547]: W0708 09:48:57.879826    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69ad6342_4ae7_4a72_858d_0ff9797bc77c.slice/crio-47cc95ebe46981828465792cb53e97ae0ae13b1638509edba2d3a7c8871e4a13 WatchSource:0}: Error finding container 47cc95ebe46981828465792cb53e97ae0ae13b1638509edba2d3a7c8871e4a13: Status 404 returned error can't find the container with id 47cc95ebe46981828465792cb53e97ae0ae13b1638509edba2d3a7c8871e4a13
Jul 08 09:48:57.881844 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:57.881822    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 09:48:58.635886 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:58.635841    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prsl4/must-gather-5vlkk" event={"ID":"69ad6342-4ae7-4a72-858d-0ff9797bc77c","Type":"ContainerStarted","Data":"47cc95ebe46981828465792cb53e97ae0ae13b1638509edba2d3a7c8871e4a13"}
Jul 08 09:48:59.647007 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:59.646960    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prsl4/must-gather-5vlkk" event={"ID":"69ad6342-4ae7-4a72-858d-0ff9797bc77c","Type":"ContainerStarted","Data":"799377232e2397ce86ad9d4ff8d2be944976c10a36fca696cba6ae548b34ebdc"}
Jul 08 09:48:59.647474 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:59.647019    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prsl4/must-gather-5vlkk" event={"ID":"69ad6342-4ae7-4a72-858d-0ff9797bc77c","Type":"ContainerStarted","Data":"a235b4a897e8d729a6735ed65b2fabf5c84c8d7357421083216744f40ee770fb"}
Jul 08 09:48:59.664772 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:48:59.664717    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-prsl4/must-gather-5vlkk" podStartSLOduration=1.616763733 podStartE2EDuration="2.664696316s" totalImagesPullingTime="1.047932583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 09:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:48:59.664400389 +0000 UTC m=+2516.174174115" watchObservedRunningTime="2026-07-08 09:48:59.664696316 +0000 UTC m=+2516.174470042"
Jul 08 09:49:00.693626 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:00.693593    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mzmh8_21f38273-da84-4f9c-84cc-b9c6a2285fdd/global-pull-secret-syncer/0.log"
Jul 08 09:49:00.861663 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:00.861619    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hj9wl_71affc53-ce18-464f-b286-5a85131e8173/konnectivity-agent/0.log"
Jul 08 09:49:00.925836 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:00.925798    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-104.ec2.internal_190de35898b6b85a611194d4297a6c4e/haproxy/0.log"
Jul 08 09:49:06.171480 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:06.167791    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c674bdc68-jtpwr_8f856ca0-b9bb-405b-8563-80f5fe02e0a1/authorino/0.log"
Jul 08 09:49:06.537235 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:06.537131    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ts2dw_45882c27-e14a-4456-8ed7-75ef33d763a7/limitador/0.log"
Jul 08 09:49:08.588109 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:08.588075    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-2tvh6_04fdc79f-40b7-403c-8b3e-f6488a78161f/cluster-monitoring-operator/0.log"
Jul 08 09:49:08.746014 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:08.745985    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rcmbv_508f60fb-a780-4065-a0ae-cc134016086c/monitoring-plugin/0.log"
Jul 08 09:49:08.868276 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:08.868187    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkjph_714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95/node-exporter/0.log"
Jul 08 09:49:08.892742 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:08.892707    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkjph_714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95/kube-rbac-proxy/0.log"
Jul 08 09:49:08.919024 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:08.918992    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkjph_714a3e2e-7a11-46ee-ad0e-9f33ab0f9a95/init-textfile/0.log"
Jul 08 09:49:09.383353 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.383318    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-nnsql_341e3f40-b8ff-489d-b48d-2b1d666c5907/prometheus-operator-admission-webhook/0.log"
Jul 08 09:49:09.509134 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.509106    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/thanos-query/0.log"
Jul 08 09:49:09.534282 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.534251    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/kube-rbac-proxy-web/0.log"
Jul 08 09:49:09.561301 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.561272    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/kube-rbac-proxy/0.log"
Jul 08 09:49:09.586827 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.586794    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/prom-label-proxy/0.log"
Jul 08 09:49:09.612772 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.612743    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/kube-rbac-proxy-rules/0.log"
Jul 08 09:49:09.637105 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:09.637017    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6548d977-fwbbd_72913a0a-0b01-4523-b7c8-04ce1ebd71c5/kube-rbac-proxy-metrics/0.log"
Jul 08 09:49:11.291846 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.291811    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"]
Jul 08 09:49:11.299087 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.299048    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.308733 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.308287    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"]
Jul 08 09:49:11.367479 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.366787    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f257d\" (UniqueName: \"kubernetes.io/projected/10e711af-4dcc-4095-bc84-bc46e4fc090e-kube-api-access-f257d\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.367479 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.366894    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-sys\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.367479 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.366946    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-proc\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.367479 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.366970    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-podres\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.367479 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.366998    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-lib-modules\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.447135 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.447098    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/2.log"
Jul 08 09:49:11.454946 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.454912    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gpkrt_d35c77b3-8d9d-4781-8317-b79cc528bc92/console-operator/3.log"
Jul 08 09:49:11.468209 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468179    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f257d\" (UniqueName: \"kubernetes.io/projected/10e711af-4dcc-4095-bc84-bc46e4fc090e-kube-api-access-f257d\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-sys\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468262    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-proc\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468283    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-podres\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468307    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-lib-modules\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468395    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-proc\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468416 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468405    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-sys\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468710 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468478    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-podres\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.468710 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.468503    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10e711af-4dcc-4095-bc84-bc46e4fc090e-lib-modules\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.479680 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.479645    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f257d\" (UniqueName: \"kubernetes.io/projected/10e711af-4dcc-4095-bc84-bc46e4fc090e-kube-api-access-f257d\") pod \"perf-node-gather-daemonset-wbvq2\" (UID: \"10e711af-4dcc-4095-bc84-bc46e4fc090e\") " pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.614543 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.614423    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:11.778408 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:11.776983    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"]
Jul 08 09:49:12.016761 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:12.016730    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-578db4f9bf-72xs9_f51f4de9-07b0-42a0-8fae-3073d33ae1b6/console/0.log"
Jul 08 09:49:12.059885 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:12.059849    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-8tfts_050467ca-09aa-4aa3-a469-54381e83f5f6/download-server/0.log"
Jul 08 09:49:12.743648 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:12.743594    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2" event={"ID":"10e711af-4dcc-4095-bc84-bc46e4fc090e","Type":"ContainerStarted","Data":"e800a47a65cad65549a072a630d40c43372d437e4fe480d944b617bec9a282cb"}
Jul 08 09:49:12.744126 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:12.743677    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2" event={"ID":"10e711af-4dcc-4095-bc84-bc46e4fc090e","Type":"ContainerStarted","Data":"4d1fc7623cc5ae0c446b5ff6ee375ebdc73d2997ae81d03f4cf16792e274fdac"}
Jul 08 09:49:12.744748 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:12.744591    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:13.830138 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:13.830097    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlzc6_f0046c92-6ac6-495e-818a-e1ceb8ed2456/dns/0.log"
Jul 08 09:49:13.857295 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:13.857265    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlzc6_f0046c92-6ac6-495e-818a-e1ceb8ed2456/kube-rbac-proxy/0.log"
Jul 08 09:49:14.036569 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:14.036543    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9jqnv_a5b73df2-ed31-43aa-8d3f-65fbbdf67185/dns-node-resolver/0.log"
Jul 08 09:49:14.727222 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:14.727191    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7jv4_3923a524-da38-4f1b-820b-c587360b2aa7/node-ca/0.log"
Jul 08 09:49:15.944790 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:15.944756    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5458fdb769-wfz7k_5a44171d-4e52-43ed-ab93-33d1a6c66a25/kube-auth-proxy/0.log"
Jul 08 09:49:16.879218 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:16.879189    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ssw7_ce5fba4a-b1c3-4ca8-8221-71e4194cc250/serve-healthcheck-canary/0.log"
Jul 08 09:49:17.532510 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:17.532450    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-nv7hn_6eb3acd7-d580-4802-a1a8-a0859b4e20f5/insights-operator/0.log"
Jul 08 09:49:17.535344 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:17.535302    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-nv7hn_6eb3acd7-d580-4802-a1a8-a0859b4e20f5/insights-operator/1.log"
Jul 08 09:49:17.734028 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:17.733996    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4v4q_8c93af8a-7b72-4203-887e-1a45bd8ae671/kube-rbac-proxy/0.log"
Jul 08 09:49:17.759771 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:17.759740    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4v4q_8c93af8a-7b72-4203-887e-1a45bd8ae671/exporter/0.log"
Jul 08 09:49:17.788080 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:17.787984    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4v4q_8c93af8a-7b72-4203-887e-1a45bd8ae671/extractor/0.log"
Jul 08 09:49:19.767361 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:19.767326    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2"
Jul 08 09:49:19.789401 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:19.789350    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-prsl4/perf-node-gather-daemonset-wbvq2" podStartSLOduration=8.789333653 podStartE2EDuration="8.789333653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 09:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 09:49:12.766425604 +0000 UTC m=+2529.276199351" watchObservedRunningTime="2026-07-08 09:49:19.789333653 +0000 UTC m=+2536.299107382"
Jul 08 09:49:21.033386 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:21.033355    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d6485f98-vnm6p_d1e220c6-773f-4b14-bd99-a9607a8b21c5/manager/0.log"
Jul 08 09:49:21.066403 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:21.066375    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d6485f98-vnm6p_d1e220c6-773f-4b14-bd99-a9607a8b21c5/copy-manifests/0.log"
Jul 08 09:49:21.909923 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:21.909885    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5458fdb769-wfz7k_5a44171d-4e52-43ed-ab93-33d1a6c66a25/kube-auth-proxy/0.log"
Jul 08 09:49:22.705495 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:22.705449    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9788fbb6-9mdcd_81d62574-7fae-4de0-9404-686b51f9ae0a/manager/0.log"
Jul 08 09:49:23.562372 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:23.562337    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5458fdb769-wfz7k_5a44171d-4e52-43ed-ab93-33d1a6c66a25/kube-auth-proxy/0.log"
Jul 08 09:49:29.739104 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.739074    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/kube-multus-additional-cni-plugins/0.log"
Jul 08 09:49:29.763035 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.763007    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/egress-router-binary-copy/0.log"
Jul 08 09:49:29.788723 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.788632    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/cni-plugins/0.log"
Jul 08 09:49:29.812974 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.812944    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/bond-cni-plugin/0.log"
Jul 08 09:49:29.836939 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.836907    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/routeoverride-cni/0.log"
Jul 08 09:49:29.861841 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.861801    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/whereabouts-cni-bincopy/0.log"
Jul 08 09:49:29.883969 ip-10-0-135-104 kubenswrapper[2547]: I0708 09:49:29.883920    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bc4x_734c02dc-c843-4064-80e0-1fa52fc9e9ba/whereabouts-cni/0.log"