Jul 06 22:26:58.058102 ip-10-0-135-240 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.514383    2589 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522046    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522060    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522063    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522067    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522069    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522072    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522076    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.571878 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522078    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522081    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522084    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522087    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522089    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522092    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522094    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522097    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522099    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522102    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522104    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522107    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522109    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522120    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522123    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522126    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522129    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522132    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522135    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522138    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.586293 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522140    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522143    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522146    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522150    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522154    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522158    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522162    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522165    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522169    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522172    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522175    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522178    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522181    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522184    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522187    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522189    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522192    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522195    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522198    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.588425 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522200    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522203    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522205    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522208    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522210    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522213    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522215    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522218    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522220    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522223    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522225    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522228    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522230    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522233    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522236    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522238    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522241    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522244    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522246    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522249    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.590972 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522251    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522254    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522256    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522259    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522263    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522265    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522268    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522270    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522273    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522277    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522282    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522285    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522289    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522292    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522295    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522298    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522301    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522305    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522308    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.593023 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522311    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522313    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522316    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522318    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522321    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522324    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522326    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522330    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522332    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522335    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522338    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522340    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522343    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.522345    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523056    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523062    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523065    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523068    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523071    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523073    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.595239 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523076    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523078    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523081    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523083    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523087    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523090    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523093    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523095    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523098    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523101    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523103    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523106    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523108    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523112    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523115    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523118    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523120    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523123    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523125    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523128    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.610047 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523130    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.600134 ip-10-0-135-240 systemd[1]: Started Kubernetes Kubelet.
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523133    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523135    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523138    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523140    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523142    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523145    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523147    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523149    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523152    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523154    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523157    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523159    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523162    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523164    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523166    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523173    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523175    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523178    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.612955 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523181    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523183    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523186    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523188    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523191    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523194    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523196    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523199    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523201    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523204    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523206    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523209    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523211    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523216    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523220    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523223    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523226    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523229    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523233    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.615655 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523236    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523239    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523242    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523244    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523247    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523251    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523253    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523256    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523258    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523260    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523264    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523267    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523270    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523272    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523275    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523277    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523280    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523284    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523287    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523290    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.630557 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523293    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523296    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523298    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523301    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523304    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523306    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523309    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523311    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523315    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523318    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523321    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523323    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523326    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523329    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523331    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523686    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523690    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523693    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523696    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523699    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.632867 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523701    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523704    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523709    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523711    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523715    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523717    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523720    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523723    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523726    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523728    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523732    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523735    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523737    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523740    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523743    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523745    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523748    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523751    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523754    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523756    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.646620 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523759    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523762    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523765    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523767    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523770    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523772    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523775    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523777    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523779    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523782    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523786    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523790    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523793    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523796    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523799    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523802    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523824    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523828    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523831    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.647885 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523833    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523836    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523838    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523841    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523843    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523846    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523848    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523851    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523853    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523856    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523859    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523862    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523864    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523867    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523869    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523872    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523874    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523877    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523879    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523882    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.821925 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523884    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523887    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523890    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523896    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523898    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523902    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523905    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523910    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523912    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523915    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523917    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523926    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523929    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523932    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523935    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523938    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523940    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523943    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523945    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523948    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.823664 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523950    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523953    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523955    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523958    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523960    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523963    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523965    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523968    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523970    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523973    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523975    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523977    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523980    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523984    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.523987    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524053    2589 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524060    2589 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524066    2589 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524071    2589 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524077    2589 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524080    2589 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 22:26:58.824697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524084    2589 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524088    2589 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524092    2589 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524095    2589 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524098    2589 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524102    2589 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524105    2589 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524108    2589 flags.go:64] FLAG: --cgroup-root=""
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524111    2589 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524114    2589 flags.go:64] FLAG: --client-ca-file=""
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524117    2589 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524120    2589 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524124    2589 flags.go:64] FLAG: --cluster-domain=""
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524127    2589 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524130    2589 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524133    2589 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524137    2589 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524140    2589 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524143    2589 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524146    2589 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524149    2589 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524153    2589 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524156    2589 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524159    2589 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 22:26:58.825774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524162    2589 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524164    2589 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524170    2589 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524173    2589 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524176    2589 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524179    2589 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524184    2589 flags.go:64] FLAG: --enable-server="true"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524187    2589 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524191    2589 flags.go:64] FLAG: --event-burst="100"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524194    2589 flags.go:64] FLAG: --event-qps="50"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524197    2589 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524200    2589 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524203    2589 flags.go:64] FLAG: --eviction-hard=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524207    2589 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524210    2589 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524213    2589 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524216    2589 flags.go:64] FLAG: --eviction-soft=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524219    2589 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524222    2589 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524225    2589 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524228    2589 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524230    2589 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524233    2589 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524236    2589 flags.go:64] FLAG: --feature-gates=""
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524239    2589 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 22:26:58.828246 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524242    2589 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524245    2589 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524248    2589 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524251    2589 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524254    2589 flags.go:64] FLAG: --help="false"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524257    2589 flags.go:64] FLAG: --hostname-override="ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524261    2589 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524264    2589 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524266    2589 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524272    2589 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524275    2589 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524278    2589 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524281    2589 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524285    2589 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524288    2589 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524291    2589 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524294    2589 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524297    2589 flags.go:64] FLAG: --kube-reserved=""
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524299    2589 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524302    2589 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524306    2589 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524309    2589 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524312    2589 flags.go:64] FLAG: --lock-file=""
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524314    2589 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 22:26:58.830100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524317    2589 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524320    2589 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524326    2589 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524329    2589 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524332    2589 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524335    2589 flags.go:64] FLAG: --logging-format="text"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524337    2589 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524341    2589 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524343    2589 flags.go:64] FLAG: --manifest-url=""
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524346    2589 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524350    2589 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524353    2589 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524357    2589 flags.go:64] FLAG: --max-pods="110"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524360    2589 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524363    2589 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524365    2589 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524368    2589 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524373    2589 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524376    2589 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524379    2589 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524385    2589 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524389    2589 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524392    2589 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 22:26:58.832424 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524396    2589 flags.go:64] FLAG: --pod-cidr=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524399    2589 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524405    2589 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524408    2589 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524411    2589 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524414    2589 flags.go:64] FLAG: --port="10250"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524418    2589 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524420    2589 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e8316b204aa71c20"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524424    2589 flags.go:64] FLAG: --qos-reserved=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524427    2589 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524429    2589 flags.go:64] FLAG: --register-node="true"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524432    2589 flags.go:64] FLAG: --register-with-taints=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524442    2589 flags.go:64] FLAG: --registry-burst="10"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524445    2589 flags.go:64] FLAG: --registry-qps="5"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524448    2589 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524450    2589 flags.go:64] FLAG: --reserved-memory=""
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524454    2589 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524457    2589 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524460    2589 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524463    2589 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524466    2589 flags.go:64] FLAG: --runonce="false"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524469    2589 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524472    2589 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524475    2589 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524478    2589 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 22:26:58.842518 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524481    2589 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524486    2589 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524489    2589 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524491    2589 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524494    2589 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524497    2589 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524501    2589 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524504    2589 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524507    2589 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524510    2589 flags.go:64] FLAG: --system-cgroups=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524513    2589 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524518    2589 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524521    2589 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524524    2589 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524529    2589 flags.go:64] FLAG: --tls-min-version=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524532    2589 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524534    2589 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524537    2589 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524540    2589 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524543    2589 flags.go:64] FLAG: --v="2"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524546    2589 flags.go:64] FLAG: --version="false"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524550    2589 flags.go:64] FLAG: --vmodule=""
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524554    2589 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.524557    2589 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524687    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.843662 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524691    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524695    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524698    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524700    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524703    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524705    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524709    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524711    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524715    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524718    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524720    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524723    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524725    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524729    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524732    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524735    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524737    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524740    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524743    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524745    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.850689 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524748    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524750    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524753    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524756    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524759    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524762    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524764    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524767    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524769    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524772    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524774    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524777    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524779    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524781    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524784    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524787    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524789    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524792    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524794    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524797    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.851315 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524802    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524818    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524821    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524823    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524826    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524831    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524833    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524836    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524838    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524841    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524845    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524849    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524851    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524854    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524856    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524859    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524862    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524864    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524867    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.851937 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524870    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524872    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524875    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524877    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524880    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524882    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524885    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524887    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524890    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524892    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524895    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524897    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524900    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524904    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524906    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524909    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524911    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524913    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524917    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524920    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.852559 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524922    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524925    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524928    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524930    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524935    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524946    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524952    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524957    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524962    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524967    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524971    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524974    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524978    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524982    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524986    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524989    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524992    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524995    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.853187 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.524997    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.525002    2589 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.533524    2589 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.533539    2589 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.534491    2589 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.534499    2589 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534563    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534568    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534571    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534574    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534577    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534579    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534582    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534585    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534588    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.854064 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534590    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534594    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534596    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534599    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534602    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534604    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534607    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534610    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534613    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534616    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534618    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534621    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534626    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534629    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534631    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534635    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534638    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534642    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534645    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.854656 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534649    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534652    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534655    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534660    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534663    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534666    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534669    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534671    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534674    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534677    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534681    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534684    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534687    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534690    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534693    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534696    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534699    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534701    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534705    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.855264 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534707    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534710    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534713    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534716    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534718    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534721    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534725    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534728    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534730    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534733    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534736    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534738    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534741    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534743    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534746    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534748    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534751    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534753    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534756    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.855765 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534758    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534761    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534763    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534766    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534768    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534771    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534773    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534776    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534778    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534781    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534783    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534786    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534789    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534793    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534796    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534798    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534801    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534820    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534824    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534827    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.856321 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534830    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534833    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534835    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534838    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534840    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534843    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534846    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534848    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534851    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534855    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534858    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534860    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534863    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.534868    2589 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534988    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534993    2589 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 22:26:58.856876 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534996    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.534999    2589 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535002    2589 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535005    2589 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535008    2589 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535011    2589 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535013    2589 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535016    2589 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535019    2589 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535021    2589 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535025    2589 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535027    2589 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535030    2589 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535033    2589 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535035    2589 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535040    2589 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535043    2589 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535045    2589 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535048    2589 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535056    2589 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 22:26:58.857423 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535059    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535061    2589 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535064    2589 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535066    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535069    2589 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535072    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535077    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535080    2589 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535082    2589 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535085    2589 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535088    2589 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535090    2589 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535093    2589 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535095    2589 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535098    2589 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535100    2589 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535103    2589 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535107    2589 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535110    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 22:26:58.858061 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535113    2589 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535116    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535119    2589 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535122    2589 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535125    2589 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535128    2589 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535131    2589 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535135    2589 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535139    2589 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535142    2589 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535145    2589 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535147    2589 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535150    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535152    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535155    2589 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535157    2589 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535160    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535162    2589 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535165    2589 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 22:26:58.858697 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535168    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535172    2589 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535174    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535177    2589 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535180    2589 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535182    2589 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535185    2589 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535188    2589 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535190    2589 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535193    2589 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535195    2589 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535198    2589 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535200    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535203    2589 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535206    2589 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535208    2589 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535211    2589 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535213    2589 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535217    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535219    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 22:26:58.859340 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535222    2589 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535226    2589 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535229    2589 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535231    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535234    2589 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535236    2589 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535239    2589 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535241    2589 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535244    2589 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535248    2589 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535251    2589 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535254    2589 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535258    2589 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535261    2589 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535264    2589 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535266    2589 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535269    2589 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535272    2589 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 22:26:58.860151 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:58.535275    2589 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.535279    2589 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.535395    2589 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.537899    2589 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.539593    2589 server.go:1019] "Starting client certificate rotation"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.539690    2589 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.539728    2589 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.542555    2589 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.543993    2589 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.555745    2589 log.go:25] "Validated CRI v1 runtime API"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.560081    2589 log.go:25] "Validated CRI v1 image API"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.561695    2589 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 22:26:58.860770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.564404    2589 fs.go:135] Filesystem UUIDs: map[072711af-3c2d-457d-99b4-1ddf5d9dd7d7:/dev/nvme0n1p4 541cb584-74db-4b21-b340-23b84ee650bf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 22:26:58.861186 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.564420    2589 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 22:26:58.861186 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.570025    2589 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.571118    2589 manager.go:216] Machine: {Timestamp:2026-07-06 22:26:58.569728587 +0000 UTC m=+0.377475644 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100271 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4cae105d31b2985c947fa43b2ce9 SystemUUID:ec2a4cae-105d-31b2-985c-947fa43b2ce9 BootID:089d9776-ff59-43fe-bfd2-db064ccb000f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:75:ca:b4:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:75:ca:b4:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:cf:bd:e1:cc:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.571224    2589 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.571303    2589 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.574880    2589 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.574913    2589 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.575795    2589 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.575817    2589 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.575824    2589 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.576734    2589 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.578729    2589 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583491    2589 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583617    2589 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583646    2589 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583658    2589 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583678    2589 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583687    2589 kubelet.go:398] "Adding apiserver pod source"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.583696    2589 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 22:26:58.861604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.584358    2589 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.584379    2589 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.590602    2589 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.593263    2589 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.593290    2589 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594837    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594851    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594857    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594863    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594871    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594877    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594885    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594890    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594897    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594902    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594910    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.594916    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.595841    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.595848    2589 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.597363    2589 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.597364    2589 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.599189    2589 server.go:1268] "Started kubelet"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.599240    2589 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.599271    2589 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.599327    2589 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.600465    2589 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.601308    2589 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.604096    2589 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.609323    2589 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.609729    2589 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.610244    2589 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.609297    2589 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-240.ec2.internal.18bfd3c48d4218d8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-240.ec2.internal,UID:ip-10-0-135-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-240.ec2.internal,},FirstTimestamp:2026-07-06 22:26:58.598975704 +0000 UTC m=+0.406722761,LastTimestamp:2026-07-06 22:26:58.598975704 +0000 UTC m=+0.406722761,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-240.ec2.internal,}"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.611041    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611584    2589 factory.go:55] Registering systemd factory
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611620    2589 factory.go:223] Registration of the systemd container factory successfully
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611710    2589 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611725    2589 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611832    2589 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611838    2589 factory.go:153] Registering CRI-O factory
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611851    2589 factory.go:223] Registration of the crio container factory successfully
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611882    2589 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 22:26:58.941217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611891    2589 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611909    2589 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611955    2589 factory.go:103] Registering Raw factory
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.611972    2589 manager.go:1196] Started watching for new ooms in manager
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.612503    2589 manager.go:349] Starting recovery of all containers
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.612739    2589 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.626201    2589 manager.go:354] Recovery completed
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.627387    2589 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.628009    2589 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qjpn6"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.630992    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633302    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633336    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633351    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633933    2589 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633944    2589 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.633962    2589 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.634201    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.634846    2589 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qjpn6"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.634906    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.634929    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.634939    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.636173    2589 policy_none.go:49] "None policy: Start"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.636185    2589 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.636195    2589 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.638132    2589 policy_none.go:47] "Start"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.679920    2589 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681096    2589 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681131    2589 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681150    2589 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.681180    2589 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681574    2589 manager.go:337] "Starting Device Plugin manager"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.681610    2589 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681624    2589 server.go:87] "Starting device plugin registration server"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681949    2589 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.681963    2589 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.682126    2589 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.682214    2589 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.682223    2589 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.682678    2589 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.682730    2589 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.683285    2589 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.781785    2589 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"]
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.781888    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.782035    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.942458 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.782923    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.782952    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.782965    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.782990    2589 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.783582    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.783605    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.783616    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.785968    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786077    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786114    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786702    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786723    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786736    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786791    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786828    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.786844    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.788952    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.788973    2589 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.789631    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.789656    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.789666    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.792859    2589 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.792874    2589 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-240.ec2.internal\": node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.813516    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.813541    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.813558    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.817648    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.832133    2589 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.837385    2589 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914494    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.946408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914525    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.947283 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914543    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.947283 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914588    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.947283 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914588    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.947283 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:58.914599    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:58.947283 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:58.918581    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.054085 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.019153    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.155338 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.119970    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.155338 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.137144    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:59.155338 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.142540    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:59.236242 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.220341    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.378973 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.320927    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.477087 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.421478    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.567005 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.522195    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.567005 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.538337    2589 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 22:26:59.567005 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.538476    2589 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 22:26:59.679347 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.622300    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.679347 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.637459    2589 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:21:59 +0000 UTC" deadline="2028-04-11 18:56:51.076546508 +0000 UTC"
Jul 06 22:26:59.679347 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.637484    2589 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15476h29m51.439065763s"
Jul 06 22:26:59.779013 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.723205    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.871338 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:26:59.824161    2589 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Jul 06 22:26:59.871338 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.851746    2589 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:26:59.871338 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.856029    2589 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:26:59.944416 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.895928    2589 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:26:59.944416 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.912036    2589 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Jul 06 22:26:59.944416 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.944033    2589 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 22:26:59.945396 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.945213    2589 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Jul 06 22:27:00.062263 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:59.949130    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8689016a7f8195ba0457e3c7b1972e.slice/crio-cb79a0d1ddfbb81c81c6ec1801d99aff5dcecb39f93c693a52ccd3e6f9b315bd WatchSource:0}: Error finding container cb79a0d1ddfbb81c81c6ec1801d99aff5dcecb39f93c693a52ccd3e6f9b315bd: Status 404 returned error can't find the container with id cb79a0d1ddfbb81c81c6ec1801d99aff5dcecb39f93c693a52ccd3e6f9b315bd
Jul 06 22:27:00.062263 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:26:59.949351    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b12c154aed0715acfb2aca1c887480a.slice/crio-66942ac52d7ce199a03712ac5d5794326243b5e7deff4b6fc8ce67631000c625 WatchSource:0}: Error finding container 66942ac52d7ce199a03712ac5d5794326243b5e7deff4b6fc8ce67631000c625: Status 404 returned error can't find the container with id 66942ac52d7ce199a03712ac5d5794326243b5e7deff4b6fc8ce67631000c625
Jul 06 22:27:00.062263 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.954872    2589 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:27:00.062263 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:26:59.960929    2589 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 22:27:00.480262 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.480224    2589 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 22:27:00.587533 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.587495    2589 apiserver.go:52] "Watching apiserver"
Jul 06 22:27:00.597205 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.597158    2589 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 22:27:00.598528 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.598502    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tljfq","kube-system/konnectivity-agent-zfjnj","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal","openshift-cluster-node-tuning-operator/tuned-b2snq","openshift-dns/node-resolver-xf8ms","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","openshift-multus/multus-qtl2d","openshift-network-operator/iptables-alerter-pw6x9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx","openshift-image-registry/node-ca-cwh7w","openshift-multus/multus-additional-cni-plugins-shmn7","openshift-multus/network-metrics-daemon-d76mt","openshift-network-diagnostics/network-check-target-sx49d","openshift-ovn-kubernetes/ovnkube-node-dnbhg"]
Jul 06 22:27:00.602623 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.602598    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.604849 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.604797    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:00.604956 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.604884    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:00.605431 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.605401    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.605555 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.605488    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 22:27:00.605555 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.605500    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 22:27:00.605713 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.605646    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.605769 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.605752    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zfhkr\""
Jul 06 22:27:00.607278 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.607262    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.609718 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.609695    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.610313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.610150    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 22:27:00.610313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.610171    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.610313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.610279    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 22:27:00.610975 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.610950    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.611092 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.611076    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 22:27:00.611158 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.611117    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wbfb8\""
Jul 06 22:27:00.611208 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.611157    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 22:27:00.611653 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.611638    2589 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 22:27:00.612306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.612284    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrmwx\""
Jul 06 22:27:00.612306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.612294    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.612479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.612287    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.612751 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.612734    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.615043 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.614991    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.615334 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.615315    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hxkgs\""
Jul 06 22:27:00.615934 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.615488    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.615934 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.615720    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.618285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.618215    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 22:27:00.618285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.618224    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.618285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.618251    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lws76\""
Jul 06 22:27:00.618954 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.618933    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.619377 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.619355    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.622528 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.622463    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 22:27:00.622528 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.622479    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.623689 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.623305    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.623689 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.623457    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.623689 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.623305    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg2n6\""
Jul 06 22:27:00.623689 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.623542    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:00.626184 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.626163    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.627741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.627545    2589 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 22:27:00.629021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.628974    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.629128 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.629110    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-94468\""
Jul 06 22:27:00.629867 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.629689    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 22:27:00.630023 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.630005    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 22:27:00.632238 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.632159    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.632560 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.632509    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 22:27:00.632635 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.632592    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 22:27:00.633741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.633648    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fw2k7\""
Jul 06 22:27:00.633741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.633669    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 22:27:00.634360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634336    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysconfig\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.634464 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634374    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-hosts-file\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.634464 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634396    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86fc918c-2782-495d-9d6e-463c59f88b50-ovn-node-metrics-cert\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634464 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634423    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4zc\" (UniqueName: \"kubernetes.io/projected/86fc918c-2782-495d-9d6e-463c59f88b50-kube-api-access-5j4zc\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634462    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-run\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634489    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjr6f\" (UniqueName: \"kubernetes.io/projected/af30a7bb-d175-49e6-b131-9c61eb165f6b-kube-api-access-sjr6f\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634534    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-netns\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634562    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-modprobe-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634589    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-system-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634615    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-host\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634707    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-socket-dir-parent\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634735    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-etc-kubernetes\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634759    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-tmp-dir\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634767    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634783    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-k8s-cni-cncf-io\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634807    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-etc-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634832    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf84q\" (UniqueName: \"kubernetes.io/projected/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-kube-api-access-gf84q\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.634837    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634877    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-daemon-config\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634896    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-bin\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634914    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634931    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-systemd-units\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634952    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-cni-binary-copy\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.634970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634970    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.634973    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-os-release\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635018    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-conf-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635056    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-tuned\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635081    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-kubelet\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635106    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-hostroot\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635139    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635182    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-lib-modules\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635206    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-node-log\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635230    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-env-overrides\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635255    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635276    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-tmp\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635300    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm86k\" (UniqueName: \"kubernetes.io/projected/2dfbdb06-75ea-4cbb-a731-7be911812fab-kube-api-access-sm86k\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635325    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-var-lib-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635347    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-ovn\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635371    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-netd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635417    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-config\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.635587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635441    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-kubernetes\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635469    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-multus\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635493    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635534    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-log-socket\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635567    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635591    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-cnibin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635615    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-systemd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635632    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635644    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-script-lib\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635674    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-bin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635700    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-kubelet\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635769    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-netns\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635821    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635852    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-slash\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635899    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-var-lib-kubelet\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635927    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-conf\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635957    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-sys\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.636545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.635981    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-multus-certs\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.637248 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.636005    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-systemd\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.637970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.637946    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r8m4k\""
Jul 06 22:27:00.676105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.676044    2589 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bw542"
Jul 06 22:27:00.689227 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.689164    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"3b12c154aed0715acfb2aca1c887480a","Type":"ContainerStarted","Data":"66942ac52d7ce199a03712ac5d5794326243b5e7deff4b6fc8ce67631000c625"}
Jul 06 22:27:00.691110 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.691079    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerStarted","Data":"cb79a0d1ddfbb81c81c6ec1801d99aff5dcecb39f93c693a52ccd3e6f9b315bd"}
Jul 06 22:27:00.692635 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.692611    2589 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bw542"
Jul 06 22:27:00.713692 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.713598    2589 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736617    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736661    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-tmp\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736690    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm86k\" (UniqueName: \"kubernetes.io/projected/2dfbdb06-75ea-4cbb-a731-7be911812fab-kube-api-access-sm86k\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736716    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-var-lib-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736743    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-ovn\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736772    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-netd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736796    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-config\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736823    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-socket-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.736906    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-kubernetes\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737012    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-netd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737069    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-var-lib-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737016    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-multus\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737106    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.737105 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737119    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-ovn\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737135    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-log-socket\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737168    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qch9\" (UniqueName: \"kubernetes.io/projected/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kube-api-access-2qch9\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737192    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-kubelet-config\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737214    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6ft\" (UniqueName: \"kubernetes.io/projected/0066e2d4-dea7-4dc7-91df-9722a09761d1-kube-api-access-fm6ft\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737236    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737264    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-cnibin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737270    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737290    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-systemd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737316    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-script-lib\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737320    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-log-socket\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737341    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-registration-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737373    2589 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737404    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-kubernetes\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737441    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737464    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737481    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41fb783a-fe29-411f-b32a-6758eaf33027-host-slash\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.738059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737502    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-bin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737530    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-kubelet\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737547    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-netns\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737563    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-sys-fs\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737565    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737581    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-dbus\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737599    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41fb783a-fe29-411f-b32a-6758eaf33027-iptables-alerter-script\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737617    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd54723d-9285-4271-a148-3dede3060239-host\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737624    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-cnibin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737651    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-system-cni-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737669    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737699    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-systemd\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737735    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-bin\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737740    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-cni-multus\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737751    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-run-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737765    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-kubelet\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737792    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:00.738981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737808    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-netns\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737823    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-slash\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737853    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-var-lib-kubelet\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737881    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-conf\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737910    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-slash\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737921    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-sys\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737954    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-multus-certs\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737978    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-sys\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738001    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-config\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738028    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-var-lib-kubelet\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738070    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-multus-certs\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738165    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysctl-conf\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.737983    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-os-release\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738532    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-systemd\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738567    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738589    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbk9\" (UniqueName: \"kubernetes.io/projected/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-kube-api-access-pgbk9\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738612    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-ovnkube-script-lib\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.739906 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738613    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysconfig\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738651    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-hosts-file\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738660    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-sysconfig\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738671    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86fc918c-2782-495d-9d6e-463c59f88b50-ovn-node-metrics-cert\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738691    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4zc\" (UniqueName: \"kubernetes.io/projected/86fc918c-2782-495d-9d6e-463c59f88b50-kube-api-access-5j4zc\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738704    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-systemd\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738709    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738728    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47p6w\" (UniqueName: \"kubernetes.io/projected/bd54723d-9285-4271-a148-3dede3060239-kube-api-access-47p6w\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738751    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-run\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738775    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-hosts-file\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738777    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjr6f\" (UniqueName: \"kubernetes.io/projected/af30a7bb-d175-49e6-b131-9c61eb165f6b-kube-api-access-sjr6f\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738821    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cnibin\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738848    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-netns\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738875    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-modprobe-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738922    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-system-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738951    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.738980    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-host\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.740741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739007    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-socket-dir-parent\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739057    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-etc-kubernetes\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739080    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-tmp-dir\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739134    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-run\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739190    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-k8s-cni-cncf-io\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739236    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-etc-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739268    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5467990-b657-4b27-8e5a-0b3ef3404c8a-konnectivity-ca\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739316    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf84q\" (UniqueName: \"kubernetes.io/projected/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-kube-api-access-gf84q\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739344    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-daemon-config\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739390    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-tmp-dir\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739391    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-bin\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739455    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-cni-bin\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739477    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739510    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739538    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2wzx\" (UniqueName: \"kubernetes.io/projected/41fb783a-fe29-411f-b32a-6758eaf33027-kube-api-access-n2wzx\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739566    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-systemd-units\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739595    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-cni-binary-copy\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.741774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739620    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-os-release\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739649    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-conf-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739678    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739706    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-tuned\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739732    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-kubelet\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739747    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-k8s-cni-cncf-io\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739757    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-hostroot\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739789    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739816    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-device-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739794    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-etc-openvswitch\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739849    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-lib-modules\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739901    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-run-netns\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739910    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-node-log\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739940    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-env-overrides\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739982    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd54723d-9285-4271-a148-3dede3060239-serviceca\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.739998    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-modprobe-d\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740013    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5467990-b657-4b27-8e5a-0b3ef3404c8a-agent-certs\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740051    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-system-cni-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.742654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740117    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-socket-dir-parent\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740162    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-host\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740204    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-etc-kubernetes\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740272    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740335    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-systemd-units\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740795    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfbdb06-75ea-4cbb-a731-7be911812fab-lib-modules\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740858    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-node-log\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.740846    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-cni-binary-copy\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741268    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86fc918c-2782-495d-9d6e-463c59f88b50-env-overrides\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741337    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-host-var-lib-kubelet\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741386    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-hostroot\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741422    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86fc918c-2782-495d-9d6e-463c59f88b50-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741456    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-daemon-config\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741463    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-multus-conf-dir\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.741561    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af30a7bb-d175-49e6-b131-9c61eb165f6b-os-release\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.743651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.742097    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-tmp\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.744402 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.743822    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:00.744402 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.743845    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:00.744402 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.743859    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:00.744402 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.743945    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:01.24392174 +0000 UTC m=+3.051668812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:00.744691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.744669    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2dfbdb06-75ea-4cbb-a731-7be911812fab-etc-tuned\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.746410 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.745503    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86fc918c-2782-495d-9d6e-463c59f88b50-ovn-node-metrics-cert\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.750739 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.748660    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm86k\" (UniqueName: \"kubernetes.io/projected/2dfbdb06-75ea-4cbb-a731-7be911812fab-kube-api-access-sm86k\") pod \"tuned-b2snq\" (UID: \"2dfbdb06-75ea-4cbb-a731-7be911812fab\") " pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.750739 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.749448    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf84q\" (UniqueName: \"kubernetes.io/projected/951bc210-4e3a-4d52-b73f-b6e5b0da6a78-kube-api-access-gf84q\") pod \"node-resolver-xf8ms\" (UID: \"951bc210-4e3a-4d52-b73f-b6e5b0da6a78\") " pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.750739 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.750571    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4zc\" (UniqueName: \"kubernetes.io/projected/86fc918c-2782-495d-9d6e-463c59f88b50-kube-api-access-5j4zc\") pod \"ovnkube-node-dnbhg\" (UID: \"86fc918c-2782-495d-9d6e-463c59f88b50\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.758955 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.755033    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjr6f\" (UniqueName: \"kubernetes.io/projected/af30a7bb-d175-49e6-b131-9c61eb165f6b-kube-api-access-sjr6f\") pod \"multus-qtl2d\" (UID: \"af30a7bb-d175-49e6-b131-9c61eb165f6b\") " pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.840729 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840684    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840741    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47p6w\" (UniqueName: \"kubernetes.io/projected/bd54723d-9285-4271-a148-3dede3060239-kube-api-access-47p6w\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840779    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cnibin\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840811    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.840842    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840876    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5467990-b657-4b27-8e5a-0b3ef3404c8a-konnectivity-ca\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840916    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.840971 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.840947    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:01.340923567 +0000 UTC m=+3.148670628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.840996    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2wzx\" (UniqueName: \"kubernetes.io/projected/41fb783a-fe29-411f-b32a-6758eaf33027-kube-api-access-n2wzx\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841033    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841063    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-device-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841091    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd54723d-9285-4271-a148-3dede3060239-serviceca\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841116    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5467990-b657-4b27-8e5a-0b3ef3404c8a-agent-certs\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841117    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841148    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-socket-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841179    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qch9\" (UniqueName: \"kubernetes.io/projected/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kube-api-access-2qch9\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841203    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-kubelet-config\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841229    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6ft\" (UniqueName: \"kubernetes.io/projected/0066e2d4-dea7-4dc7-91df-9722a09761d1-kube-api-access-fm6ft\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841259    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-registration-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841283    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841308    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.841360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841344    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41fb783a-fe29-411f-b32a-6758eaf33027-host-slash\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841376    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-sys-fs\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841401    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-dbus\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841428    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41fb783a-fe29-411f-b32a-6758eaf33027-iptables-alerter-script\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841432    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cnibin\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841454    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd54723d-9285-4271-a148-3dede3060239-host\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841480    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-system-cni-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841506    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841552    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-os-release\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841583    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841609    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbk9\" (UniqueName: \"kubernetes.io/projected/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-kube-api-access-pgbk9\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842072 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.841969    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.842614 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842243    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.842614 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842300    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-device-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.842614 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842383    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5467990-b657-4b27-8e5a-0b3ef3404c8a-konnectivity-ca\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.842614 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842429    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41fb783a-fe29-411f-b32a-6758eaf33027-host-slash\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.842822 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842718    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd54723d-9285-4271-a148-3dede3060239-serviceca\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.842893 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842836    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-socket-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.842956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842916    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-sys-fs\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.843008 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842972    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-dbus\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.843008 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.842991    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f71a1ac-fa08-4e66-8cc4-74e402b99619-kubelet-config\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:00.843486 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843462    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41fb783a-fe29-411f-b32a-6758eaf33027-iptables-alerter-script\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.843573 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843546    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-os-release\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.843652 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843630    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.843730 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843705    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd54723d-9285-4271-a148-3dede3060239-host\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.843828 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843755    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-system-cni-dir\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.844437 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.843992    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.844437 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.844126    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.844437 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.844174    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d76699c-615d-49fd-90cf-ba6a0decd7f1-registration-dir\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.844437 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.844367    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:00.844437 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:00.844435    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:01.344418203 +0000 UTC m=+3.152165263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:00.847354 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.847328    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5467990-b657-4b27-8e5a-0b3ef3404c8a-agent-certs\") pod \"konnectivity-agent-zfjnj\" (UID: \"f5467990-b657-4b27-8e5a-0b3ef3404c8a\") " pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.853992 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.853920    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbk9\" (UniqueName: \"kubernetes.io/projected/1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1-kube-api-access-pgbk9\") pod \"multus-additional-cni-plugins-shmn7\" (UID: \"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1\") " pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.854665 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.854615    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47p6w\" (UniqueName: \"kubernetes.io/projected/bd54723d-9285-4271-a148-3dede3060239-kube-api-access-47p6w\") pod \"node-ca-cwh7w\" (UID: \"bd54723d-9285-4271-a148-3dede3060239\") " pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.855988 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.855334    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2wzx\" (UniqueName: \"kubernetes.io/projected/41fb783a-fe29-411f-b32a-6758eaf33027-kube-api-access-n2wzx\") pod \"iptables-alerter-pw6x9\" (UID: \"41fb783a-fe29-411f-b32a-6758eaf33027\") " pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.857403 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.857378    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qch9\" (UniqueName: \"kubernetes.io/projected/3d76699c-615d-49fd-90cf-ba6a0decd7f1-kube-api-access-2qch9\") pod \"aws-ebs-csi-driver-node-rfsjx\" (UID: \"3d76699c-615d-49fd-90cf-ba6a0decd7f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.857545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.857507    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6ft\" (UniqueName: \"kubernetes.io/projected/0066e2d4-dea7-4dc7-91df-9722a09761d1-kube-api-access-fm6ft\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:00.913631 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.913566    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qtl2d"
Jul 06 22:27:00.923355 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.923110    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:00.929502 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.929448    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf30a7bb_d175_49e6_b131_9c61eb165f6b.slice/crio-52222010cf2993ff9cb918ad5ea065400fa59c342606165b441a981ab019ec04 WatchSource:0}: Error finding container 52222010cf2993ff9cb918ad5ea065400fa59c342606165b441a981ab019ec04: Status 404 returned error can't find the container with id 52222010cf2993ff9cb918ad5ea065400fa59c342606165b441a981ab019ec04
Jul 06 22:27:00.933691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.933668    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2snq"
Jul 06 22:27:00.938676 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.938652    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xf8ms"
Jul 06 22:27:00.938906 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.938866    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fc918c_2782_495d_9d6e_463c59f88b50.slice/crio-672a6fc7a101442e035a7e4ffc76e1ebbc4026eb729d0927bb50ef5af9e0aeac WatchSource:0}: Error finding container 672a6fc7a101442e035a7e4ffc76e1ebbc4026eb729d0927bb50ef5af9e0aeac: Status 404 returned error can't find the container with id 672a6fc7a101442e035a7e4ffc76e1ebbc4026eb729d0927bb50ef5af9e0aeac
Jul 06 22:27:00.946934 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.946859    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pw6x9"
Jul 06 22:27:00.947322 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.947287    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfbdb06_75ea_4cbb_a731_7be911812fab.slice/crio-8d6efb431cb8016532de4012a0842e5b291c4c57006903b8d157b01bfab0c2a1 WatchSource:0}: Error finding container 8d6efb431cb8016532de4012a0842e5b291c4c57006903b8d157b01bfab0c2a1: Status 404 returned error can't find the container with id 8d6efb431cb8016532de4012a0842e5b291c4c57006903b8d157b01bfab0c2a1
Jul 06 22:27:00.951358 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.951324    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951bc210_4e3a_4d52_b73f_b6e5b0da6a78.slice/crio-15330f1720a65fcccf40a5853eb5341249581f8d485a05c80d599c0a9a8d1509 WatchSource:0}: Error finding container 15330f1720a65fcccf40a5853eb5341249581f8d485a05c80d599c0a9a8d1509: Status 404 returned error can't find the container with id 15330f1720a65fcccf40a5853eb5341249581f8d485a05c80d599c0a9a8d1509
Jul 06 22:27:00.957080 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.957053    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fb783a_fe29_411f_b32a_6758eaf33027.slice/crio-2559a547d0ef0fe74c7432e47bafa6c2a7e637b1973e6f2ad95dd4b1184f408a WatchSource:0}: Error finding container 2559a547d0ef0fe74c7432e47bafa6c2a7e637b1973e6f2ad95dd4b1184f408a: Status 404 returned error can't find the container with id 2559a547d0ef0fe74c7432e47bafa6c2a7e637b1973e6f2ad95dd4b1184f408a
Jul 06 22:27:00.961012 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.960910    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx"
Jul 06 22:27:00.968481 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.968456    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:00.973152 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.973119    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d76699c_615d_49fd_90cf_ba6a0decd7f1.slice/crio-53d4b07945b19db0c15da2dd83d82c060e9290ca05d03fe1d8172f36b42f0976 WatchSource:0}: Error finding container 53d4b07945b19db0c15da2dd83d82c060e9290ca05d03fe1d8172f36b42f0976: Status 404 returned error can't find the container with id 53d4b07945b19db0c15da2dd83d82c060e9290ca05d03fe1d8172f36b42f0976
Jul 06 22:27:00.975314 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.975283    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwh7w"
Jul 06 22:27:00.978549 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.978517    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5467990_b657_4b27_8e5a_0b3ef3404c8a.slice/crio-5ea930737c4829eb2bc08e881ac36e68c116abd97ab3d983325b5d8b4be4a8c0 WatchSource:0}: Error finding container 5ea930737c4829eb2bc08e881ac36e68c116abd97ab3d983325b5d8b4be4a8c0: Status 404 returned error can't find the container with id 5ea930737c4829eb2bc08e881ac36e68c116abd97ab3d983325b5d8b4be4a8c0
Jul 06 22:27:00.983583 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:00.983558    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shmn7"
Jul 06 22:27:00.988202 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.988175    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd54723d_9285_4271_a148_3dede3060239.slice/crio-93f245177c6ac9bef3f774d2313187b1538df68147169ea635c9b7c6c9caae24 WatchSource:0}: Error finding container 93f245177c6ac9bef3f774d2313187b1538df68147169ea635c9b7c6c9caae24: Status 404 returned error can't find the container with id 93f245177c6ac9bef3f774d2313187b1538df68147169ea635c9b7c6c9caae24
Jul 06 22:27:00.995758 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:00.995732    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aeacd19_3d2f_48f1_b02e_fbf9c1769bf1.slice/crio-2d1241e410270de9a6466673b6b77f195225de673bdaf65815ac9fb338798fa0 WatchSource:0}: Error finding container 2d1241e410270de9a6466673b6b77f195225de673bdaf65815ac9fb338798fa0: Status 404 returned error can't find the container with id 2d1241e410270de9a6466673b6b77f195225de673bdaf65815ac9fb338798fa0
Jul 06 22:27:01.244074 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.243981    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:01.244253 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.244155    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:01.244253 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.244183    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:01.244253 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.244197    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:01.244413 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.244274    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:02.244252555 +0000 UTC m=+4.051999605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:01.344750 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.344705    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:01.344968 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.344867    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:01.344968 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.344931    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:01.344968 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.344947    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:02.344928051 +0000 UTC m=+4.152675105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:01.345141 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:01.344995    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:02.344977931 +0000 UTC m=+4.152724992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:01.345451 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.344798    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:01.694863 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.694751    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2snq" event={"ID":"2dfbdb06-75ea-4cbb-a731-7be911812fab","Type":"ContainerStarted","Data":"8d6efb431cb8016532de4012a0842e5b291c4c57006903b8d157b01bfab0c2a1"}
Jul 06 22:27:01.695783 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.695732    2589 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:22:01 +0000 UTC" deadline="2028-01-25 12:50:13.107181669 +0000 UTC"
Jul 06 22:27:01.695864 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.695784    2589 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13622h23m11.411401137s"
Jul 06 22:27:01.696840 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.696743    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"672a6fc7a101442e035a7e4ffc76e1ebbc4026eb729d0927bb50ef5af9e0aeac"}
Jul 06 22:27:01.698409 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.698378    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qtl2d" event={"ID":"af30a7bb-d175-49e6-b131-9c61eb165f6b","Type":"ContainerStarted","Data":"52222010cf2993ff9cb918ad5ea065400fa59c342606165b441a981ab019ec04"}
Jul 06 22:27:01.700045 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.700016    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerStarted","Data":"2d1241e410270de9a6466673b6b77f195225de673bdaf65815ac9fb338798fa0"}
Jul 06 22:27:01.702245 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.702190    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwh7w" event={"ID":"bd54723d-9285-4271-a148-3dede3060239","Type":"ContainerStarted","Data":"93f245177c6ac9bef3f774d2313187b1538df68147169ea635c9b7c6c9caae24"}
Jul 06 22:27:01.704306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.704279    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfjnj" event={"ID":"f5467990-b657-4b27-8e5a-0b3ef3404c8a","Type":"ContainerStarted","Data":"5ea930737c4829eb2bc08e881ac36e68c116abd97ab3d983325b5d8b4be4a8c0"}
Jul 06 22:27:01.707032 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.706991    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pw6x9" event={"ID":"41fb783a-fe29-411f-b32a-6758eaf33027","Type":"ContainerStarted","Data":"2559a547d0ef0fe74c7432e47bafa6c2a7e637b1973e6f2ad95dd4b1184f408a"}
Jul 06 22:27:01.708486 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.708461    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xf8ms" event={"ID":"951bc210-4e3a-4d52-b73f-b6e5b0da6a78","Type":"ContainerStarted","Data":"15330f1720a65fcccf40a5853eb5341249581f8d485a05c80d599c0a9a8d1509"}
Jul 06 22:27:01.710871 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:01.710840    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx" event={"ID":"3d76699c-615d-49fd-90cf-ba6a0decd7f1","Type":"ContainerStarted","Data":"53d4b07945b19db0c15da2dd83d82c060e9290ca05d03fe1d8172f36b42f0976"}
Jul 06 22:27:02.254436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.254394    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:02.254625 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.254600    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:02.254625 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.254625    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:02.254747 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.254638    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:02.254747 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.254702    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:04.254681985 +0000 UTC m=+6.062429046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:02.355127 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.355087    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:02.355321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.355165    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:02.355321 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.355307    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:02.355434 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.355374    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:04.35535259 +0000 UTC m=+6.163099637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:02.355845 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.355822    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:02.355962 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.355881    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:04.355864786 +0000 UTC m=+6.163611832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:02.683748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.683667    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:02.683932 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.683805    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:02.684266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.684238    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:02.684397 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.684335    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:02.684463 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.684410    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:02.684516 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:02.684503    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:02.698849 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.696289    2589 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:22:01 +0000 UTC" deadline="2028-01-13 09:06:00.22940701 +0000 UTC"
Jul 06 22:27:02.698849 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:02.696322    2589 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13330h38m57.533090523s"
Jul 06 22:27:03.734238 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:03.733956    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"3b12c154aed0715acfb2aca1c887480a","Type":"ContainerStarted","Data":"d01a056bac1f161914ffbbfeb7b70ca1673326bd06b5ef81910d333ae16f8789"}
Jul 06 22:27:03.745112 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:03.744997    2589 generic.go:356] "Generic (PLEG): container finished" podID="7a8689016a7f8195ba0457e3c7b1972e" containerID="874b6cee420e6b1e78387586135894db8881a34965da1cac7d57b98776fbd172" exitCode=0
Jul 06 22:27:03.745112 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:03.745053    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerDied","Data":"874b6cee420e6b1e78387586135894db8881a34965da1cac7d57b98776fbd172"}
Jul 06 22:27:03.752724 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:03.752081    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" podStartSLOduration=3.752062591 podStartE2EDuration="3.752062591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:03.751868854 +0000 UTC m=+5.559615927" watchObservedRunningTime="2026-07-06 22:27:03.752062591 +0000 UTC m=+5.559809660"
Jul 06 22:27:04.276641 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.276548    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:04.276812 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.276732    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:04.276812 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.276753    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:04.276812 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.276766    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:04.277040 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.276823    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:08.276804957 +0000 UTC m=+10.084552017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:04.377768 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.377699    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:04.377988 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.377776    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:04.377988 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.377967    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:04.378122 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.378047    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:08.37802723 +0000 UTC m=+10.185774279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:04.378504 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.378485    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:04.378577 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.378547    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:08.378529433 +0000 UTC m=+10.186276483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:04.684436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.684355    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:04.684598 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.684489    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:04.684790 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.684771    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:04.684882 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.684862    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:04.684941 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:04.684925    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:04.685030 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:04.685010    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:06.681974 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:06.681933    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:06.682520 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:06.682084    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:06.682520 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:06.682483    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:06.682668 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:06.682604    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:06.682668 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:06.682657    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:06.682784 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:06.682760    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:08.310683 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.310639    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:08.311215 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.310888    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:08.311215 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.310918    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:08.311215 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.310935    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:08.311215 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.311006    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:16.310983737 +0000 UTC m=+18.118730789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:08.411054 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.411000    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:08.411239 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.411093    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:08.411239 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.411231    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:08.411368 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.411309    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:16.41128022 +0000 UTC m=+18.219027268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:08.411368 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.411231    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:08.411480 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.411401    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:16.411377337 +0000 UTC m=+18.219124388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.683155    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.683263    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.683283    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:08.683393    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.683487    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:08.683704 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:08.683529    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:10.681899 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:10.681856    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:10.681899 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:10.681880    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:10.682415 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:10.681856    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:10.682415 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:10.681990    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:10.682415 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:10.682108    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:10.682415 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:10.682195    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:12.682322 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.682087    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:12.682738 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.682088    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:12.682738 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:12.682434    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:12.682738 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.682140    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:12.682738 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:12.682510    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:12.682738 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:12.682624    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:12.766932 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.766849    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerStarted","Data":"f455e314c766ea6e7ba9554444b424cf23bfe2eb6cba376322e8c541012d2957"}
Jul 06 22:27:12.768696 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.768665    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx" event={"ID":"3d76699c-615d-49fd-90cf-ba6a0decd7f1","Type":"ContainerStarted","Data":"7b16b2493ccaaa8a2098bb0c2382389c9c65f83b310ed07c7f064b7965e88785"}
Jul 06 22:27:12.770446 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.770336    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2snq" event={"ID":"2dfbdb06-75ea-4cbb-a731-7be911812fab","Type":"ContainerStarted","Data":"5152ecc7a91a16857405f45d81586c789ab831b859fc349cdb9b5d17065a3c6a"}
Jul 06 22:27:12.772119 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.772078    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="210e935d438f0d3318edca2a143f9864448b531c0f92166d60c76b590e840c17" exitCode=0
Jul 06 22:27:12.772226 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.772119    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"210e935d438f0d3318edca2a143f9864448b531c0f92166d60c76b590e840c17"}
Jul 06 22:27:12.774620 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.774598    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwh7w" event={"ID":"bd54723d-9285-4271-a148-3dede3060239","Type":"ContainerStarted","Data":"8b8b7c6f3b989c4b5c8da33f6431e1a508321bbbc49224feef849ffad5250ca0"}
Jul 06 22:27:12.776865 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.776841    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfjnj" event={"ID":"f5467990-b657-4b27-8e5a-0b3ef3404c8a","Type":"ContainerStarted","Data":"53c45c46e5cd809027b2d63307a188c6517177db05a39623b7fdcb0ee106e047"}
Jul 06 22:27:12.778526 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.778504    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xf8ms" event={"ID":"951bc210-4e3a-4d52-b73f-b6e5b0da6a78","Type":"ContainerStarted","Data":"cc1a7de61a8cc35b96a8b7d06c90fa252c88a9e9fefb39e677ed414703484ffc"}
Jul 06 22:27:12.784225 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.783921    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" podStartSLOduration=12.783904141 podStartE2EDuration="12.783904141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:12.783359753 +0000 UTC m=+14.591106820" watchObservedRunningTime="2026-07-06 22:27:12.783904141 +0000 UTC m=+14.591651209"
Jul 06 22:27:12.816257 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.816215    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b2snq" podStartSLOduration=2.50753032 podStartE2EDuration="13.816200497s" totalImagesPullingTime="11.308670177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:12.802401297 +0000 UTC m=+14.610148368" watchObservedRunningTime="2026-07-06 22:27:12.816200497 +0000 UTC m=+14.623947562"
Jul 06 22:27:12.816564 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.816535    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cwh7w" podStartSLOduration=2.55104812 podStartE2EDuration="13.816529245s" totalImagesPullingTime="11.265481125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:12.816156945 +0000 UTC m=+14.623904004" watchObservedRunningTime="2026-07-06 22:27:12.816529245 +0000 UTC m=+14.624276311"
Jul 06 22:27:12.834950 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.834915    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xf8ms" podStartSLOduration=2.531479879 podStartE2EDuration="13.834902481s" totalImagesPullingTime="11.303422602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:12.834476021 +0000 UTC m=+14.642223087" watchObservedRunningTime="2026-07-06 22:27:12.834902481 +0000 UTC m=+14.642649548"
Jul 06 22:27:12.854729 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.854692    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfjnj" podStartSLOduration=2.57695199 podStartE2EDuration="13.854678648s" totalImagesPullingTime="11.277726658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:12.854371958 +0000 UTC m=+14.662119023" watchObservedRunningTime="2026-07-06 22:27:12.854678648 +0000 UTC m=+14.662425713"
Jul 06 22:27:12.939449 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:12.939412    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:14.681933 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.681899    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:14.682485 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:14.682027    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:14.682485 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.681903    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:14.682485 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:14.682127    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:14.682485 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.681898    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:14.682485 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:14.682203    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:14.784377 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.784341    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pw6x9" event={"ID":"41fb783a-fe29-411f-b32a-6758eaf33027","Type":"ContainerStarted","Data":"68c639dcc888072e4004b06039c973dc584c60c0abc8c153d0ecf00514a40f7d"}
Jul 06 22:27:14.803381 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.803327    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pw6x9" podStartSLOduration=4.498530073 podStartE2EDuration="15.803308983s" totalImagesPullingTime="11.30477891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:14.803143649 +0000 UTC m=+16.610890715" watchObservedRunningTime="2026-07-06 22:27:14.803308983 +0000 UTC m=+16.611056049"
Jul 06 22:27:14.809380 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.809353    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:14.809935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:14.809914    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:15.787412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:15.787383    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfjnj"
Jul 06 22:27:16.374457 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.374409    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:16.374625 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.374574    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:16.374625 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.374597    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:16.374625 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.374613    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:16.374825 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.374674    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.374658005 +0000 UTC m=+34.182405052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:16.474748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.474720    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:16.474904 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.474779    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:16.474904 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.474896    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:16.475014 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.474957    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.474944224 +0000 UTC m=+34.282691271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:16.475014 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.474898    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:16.475100 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.475047    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.475030685 +0000 UTC m=+34.282777748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:16.682047 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.681962    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:16.682047 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.681981    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:16.682047 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:16.681980    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:16.682313 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.682102    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:16.682313 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.682243    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:16.682397 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:16.682321    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:18.685792 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:18.685763    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:18.686598 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:18.685762    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:18.686598 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:18.685898    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:18.686598 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:18.685947    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:18.686598 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:18.686050    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:18.686598 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:18.686137    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:20.684780 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:20.684748    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:20.685267 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:20.684872    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:20.685267 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:20.684887    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:20.685267 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:20.684907    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:20.685267 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:20.685006    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:20.685267 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:20.685101    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:21.801836 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.801451    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:27:21.802280 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802147    2589 generic.go:356] "Generic (PLEG): container finished" podID="86fc918c-2782-495d-9d6e-463c59f88b50" containerID="166998cce11f4a402c508fafbc873b08473d94195612cdebcf046d6d93700451" exitCode=1
Jul 06 22:27:21.802280 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802229    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"f2706ed9dbe3728529c1e584da077b18eeec6ec6b8878302241fecebddadcaa8"}
Jul 06 22:27:21.802381 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802367    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"e69b5a953568143c2d276bcb52c185ee0f7ed6f59035d2e3aa8b4e580a180764"}
Jul 06 22:27:21.802431 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802418    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"e2f4efe4524a91d3e3ea749551d976669fde68438fe3e6ee9f6ab4510238ca3c"}
Jul 06 22:27:21.802481 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802465    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerDied","Data":"166998cce11f4a402c508fafbc873b08473d94195612cdebcf046d6d93700451"}
Jul 06 22:27:21.802532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.802515    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"43fa0405596d0c528af1d048691779fa68eb9c7e4f799866864c164c162e69d1"}
Jul 06 22:27:21.803851 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.803829    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qtl2d" event={"ID":"af30a7bb-d175-49e6-b131-9c61eb165f6b","Type":"ContainerStarted","Data":"fd65418a50cf860b46b42f35704c698f52e03ec6383b95f50605cecb6a6d896b"}
Jul 06 22:27:21.822053 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:21.822009    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qtl2d" podStartSLOduration=2.7920262449999997 podStartE2EDuration="22.821994589s" totalImagesPullingTime="20.029968344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:21.821675717 +0000 UTC m=+23.629422784" watchObservedRunningTime="2026-07-06 22:27:21.821994589 +0000 UTC m=+23.629741655"
Jul 06 22:27:22.077770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.077733    2589 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 22:27:22.684840 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.684795    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:22.685095 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.684900    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:22.685095 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.684906    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:22.685095 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:22.684904    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:22.685095 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:22.684970    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:22.685095 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:22.685051    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:22.694022 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.693951    2589 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:27:22.077759427Z","UUID":"75feabee-74c7-45e9-9db6-78cf298fda2d","Handler":null,"Name":"","Endpoint":""}
Jul 06 22:27:22.695258 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.695240    2589 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 22:27:22.695366 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.695276    2589 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 22:27:22.807733 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.807696    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx" event={"ID":"3d76699c-615d-49fd-90cf-ba6a0decd7f1","Type":"ContainerStarted","Data":"52a97f2b1a1d1d15ff8c4600915b996fdda1fb03c8a6b4eea8f78f28cc7ab93a"}
Jul 06 22:27:22.810201 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.810179    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:27:22.810544 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:22.810525    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"e1f9ac19febb7f1d13a77684e5a249b21eb2133ed6aa7963279315e5cb43074b"}
Jul 06 22:27:23.815282 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:23.815248    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx" event={"ID":"3d76699c-615d-49fd-90cf-ba6a0decd7f1","Type":"ContainerStarted","Data":"654bcf3a60f6f2bae95adbee529c83249e9032f008ea8d77d57582fba951db97"}
Jul 06 22:27:24.686017 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:24.685977    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:24.686017 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:24.685994    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:24.686017 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:24.685993    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:24.686313 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:24.686116    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:24.686313 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:24.686249    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:24.686407 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:24.686337    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:25.822950 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:25.822927    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:27:25.823460 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:25.823268    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"451ea7f661635365d7e9a029c42af7026a4807772be14fcd13dd6a7ef83922bd"}
Jul 06 22:27:26.685243 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.685218    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:26.685398 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.685323    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:26.685398 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:26.685327    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:26.685504 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.685400    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:26.685504 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:26.685400    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:26.685504 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:26.685480    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:26.827434 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.827352    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="3285d8089c2688e829d18ecb9a3274d3538e975ec88912d70bb0e96eafe5195b" exitCode=0
Jul 06 22:27:26.827434 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.827423    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"3285d8089c2688e829d18ecb9a3274d3538e975ec88912d70bb0e96eafe5195b"}
Jul 06 22:27:26.850563 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:26.850520    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfsjx" podStartSLOduration=5.708907161 podStartE2EDuration="27.85050475s" totalImagesPullingTime="22.141597589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:24.837928644 +0000 UTC m=+26.645675711" watchObservedRunningTime="2026-07-06 22:27:26.85050475 +0000 UTC m=+28.658251851"
Jul 06 22:27:27.833604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:27.833439    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:27:27.834122 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:27.833943    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"e01efd90a40e2a5d78e336a5841f295856c3eb8e7cc85e19ebe5c0e4916b00af"}
Jul 06 22:27:27.834292 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:27.834232    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:27.834478 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:27.834461    2589 scope.go:117] "RemoveContainer" containerID="166998cce11f4a402c508fafbc873b08473d94195612cdebcf046d6d93700451"
Jul 06 22:27:27.850686 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:27.850658    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:28.682565 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.682540    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:28.682713 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.682661    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:28.682713 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.682682    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:28.682713 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:28.682667    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:28.682833 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:28.682792    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:28.682911 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:28.682895    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:28.838485 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.838453    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="944824cfa4e04a1f4caf2bb8ac5b71df1d8a8ea9316af88a5319c4c314c7ea84" exitCode=0
Jul 06 22:27:28.838921 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.838533    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"944824cfa4e04a1f4caf2bb8ac5b71df1d8a8ea9316af88a5319c4c314c7ea84"}
Jul 06 22:27:28.842213 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.842193    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:27:28.842525 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.842506    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" event={"ID":"86fc918c-2782-495d-9d6e-463c59f88b50","Type":"ContainerStarted","Data":"52db3feab8f59a32bf4c924bcb08621d13eb43be47a4bf16b9c1b38cc1dfa8c8"}
Jul 06 22:27:28.842692 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.842675    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:28.842745 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.842730    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:28.858742 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.858722    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:27:28.891388 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:28.891301    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg" podStartSLOduration=9.852046364 podStartE2EDuration="29.891287683s" totalImagesPullingTime="20.039241319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:28.889639139 +0000 UTC m=+30.697386206" watchObservedRunningTime="2026-07-06 22:27:28.891287683 +0000 UTC m=+30.699034749"
Jul 06 22:27:29.862237 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.862208    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tljfq"]
Jul 06 22:27:29.862599 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.862318    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:29.862599 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:29.862405    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:29.864674 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.864649    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sx49d"]
Jul 06 22:27:29.864768 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.864742    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:29.864857 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:29.864837    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:29.867211 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.867189    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d76mt"]
Jul 06 22:27:29.867334 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:29.867295    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:29.867426 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:29.867398    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:30.849349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:30.849092    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="a71f61c94d3f4664461d88d3701ecddae07f0b9ff8a3fe4cd8a54619f72c3239" exitCode=0
Jul 06 22:27:30.849635 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:30.849176    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"a71f61c94d3f4664461d88d3701ecddae07f0b9ff8a3fe4cd8a54619f72c3239"}
Jul 06 22:27:31.682346 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:31.682308    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:31.682924 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:31.682421    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:31.682924 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:31.682436    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:31.682924 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:31.682451    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:31.682924 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:31.682527    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:31.682924 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:31.682589    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:32.402382 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:32.402295    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:32.402549 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.402466    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 22:27:32.402549 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.402493    2589 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 22:27:32.402549 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.402505    2589 projected.go:196] Error preparing data for projected volume kube-api-access-rffj9 for pod openshift-network-diagnostics/network-check-target-sx49d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:32.402703 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.402569    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9 podName:cdd25c4c-695f-4ace-b411-2910b4c0e210 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:04.402550372 +0000 UTC m=+66.210297416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rffj9" (UniqueName: "kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9") pod "network-check-target-sx49d" (UID: "cdd25c4c-695f-4ace-b411-2910b4c0e210") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 22:27:32.503605 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:32.503570    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:32.503796 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:32.503638    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:32.503796 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.503742    2589 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:32.503939 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.503742    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:32.503939 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.503841    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret podName:6f71a1ac-fa08-4e66-8cc4-74e402b99619 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:04.503818695 +0000 UTC m=+66.311565761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret") pod "global-pull-secret-syncer-tljfq" (UID: "6f71a1ac-fa08-4e66-8cc4-74e402b99619") : object "kube-system"/"original-pull-secret" not registered
Jul 06 22:27:32.503939 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:32.503893    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:04.503874156 +0000 UTC m=+66.311621203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 22:27:33.681869 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.681776    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:33.682435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.681776    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:33.682435 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:33.681919    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d76mt" podUID="0066e2d4-dea7-4dc7-91df-9722a09761d1"
Jul 06 22:27:33.682435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.681776    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:33.682435 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:33.681995    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tljfq" podUID="6f71a1ac-fa08-4e66-8cc4-74e402b99619"
Jul 06 22:27:33.682435 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:33.682066    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sx49d" podUID="cdd25c4c-695f-4ace-b411-2910b4c0e210"
Jul 06 22:27:33.938829 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.938741    2589 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeReady"
Jul 06 22:27:33.938997 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.938907    2589 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 22:27:33.974959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.974833    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:27:33.979414 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.979394    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:33.982057 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.982035    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 22:27:33.982057 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.982036    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 22:27:33.982223 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.982074    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 22:27:33.982223 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.982159    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjrqw\""
Jul 06 22:27:33.987964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.987945    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x9k4c"]
Jul 06 22:27:33.988230 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.988211    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 22:27:33.991773 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.991755    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q5k28"]
Jul 06 22:27:33.991923 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.991905    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:33.994353 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.994331    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 22:27:33.994353 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.994344    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 22:27:33.994626 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.994610    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9fkj\""
Jul 06 22:27:33.995153 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.995139    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:27:33.995227 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.995216    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:33.997560 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.997418    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 22:27:33.997651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.997557    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mvrsx\""
Jul 06 22:27:33.997651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.997586    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 22:27:33.997762 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.997703    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 22:27:33.999587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:33.999533    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9k4c"]
Jul 06 22:27:34.002933 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.002911    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5k28"]
Jul 06 22:27:34.014627 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014604    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8142f9a7-01b0-4927-aa2b-bf431091a0c5-tmp-dir\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.014737 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014633    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cd7\" (UniqueName: \"kubernetes.io/projected/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-kube-api-access-x4cd7\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.014737 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014708    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.014883 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014767    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbhm\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.014883 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014797    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.014883 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014840    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.014883 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014861    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-cert\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.014883 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014879    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8142f9a7-01b0-4927-aa2b-bf431091a0c5-config-volume\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014898    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014916    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014939    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014970    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvmj\" (UniqueName: \"kubernetes.io/projected/8142f9a7-01b0-4927-aa2b-bf431091a0c5-kube-api-access-cwvmj\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.014992    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.015102 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.015021    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116087 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116045    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116284 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116102    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116284 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116139    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvmj\" (UniqueName: \"kubernetes.io/projected/8142f9a7-01b0-4927-aa2b-bf431091a0c5-kube-api-access-cwvmj\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.116284 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116168    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116284 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116197    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116297    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8142f9a7-01b0-4927-aa2b-bf431091a0c5-tmp-dir\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116325    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cd7\" (UniqueName: \"kubernetes.io/projected/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-kube-api-access-x4cd7\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116372    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116412    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbhm\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116440    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116459    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116477    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-cert\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.116501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116494    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8142f9a7-01b0-4927-aa2b-bf431091a0c5-config-volume\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.116848 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116518    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.116848 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.116618    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:34.116848 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.116629    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:34.116848 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.116683    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:27:34.616664364 +0000 UTC m=+36.424411421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:34.117042 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116928    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.117042 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.116972    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:34.117042 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.116981    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8142f9a7-01b0-4927-aa2b-bf431091a0c5-tmp-dir\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.117042 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.117019    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:34.617003412 +0000 UTC m=+36.424750478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:34.117208 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.117184    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.117285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.117263    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.117537 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.117517    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8142f9a7-01b0-4927-aa2b-bf431091a0c5-config-volume\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.121038 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.121020    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.121135 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.121065    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.121135 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.121085    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-cert\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.125728 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.125683    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvmj\" (UniqueName: \"kubernetes.io/projected/8142f9a7-01b0-4927-aa2b-bf431091a0c5-kube-api-access-cwvmj\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.126153 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.126136    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cd7\" (UniqueName: \"kubernetes.io/projected/db83e1fc-3963-4eb0-80ae-e9ccd2a18711-kube-api-access-x4cd7\") pod \"ingress-canary-q5k28\" (UID: \"db83e1fc-3963-4eb0-80ae-e9ccd2a18711\") " pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.126339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.126322    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.126399 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.126350    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbhm\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.309436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.309397    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5k28"
Jul 06 22:27:34.620533 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.620443    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:34.620705 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.620568    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:34.620705 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:34.620596    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:34.620705 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.620646    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:35.620622955 +0000 UTC m=+37.428370011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:34.620902 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.620728    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:34.620902 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.620743    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:34.620902 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:34.620797    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:27:35.620784108 +0000 UTC m=+37.428531157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:35.608154 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.607453    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5k28"]
Jul 06 22:27:35.612931 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:35.612902    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb83e1fc_3963_4eb0_80ae_e9ccd2a18711.slice/crio-00ed4af4f4108ef5652fae32a5310c742f38b1ff2f7fe9c20d718d93de944d5e WatchSource:0}: Error finding container 00ed4af4f4108ef5652fae32a5310c742f38b1ff2f7fe9c20d718d93de944d5e: Status 404 returned error can't find the container with id 00ed4af4f4108ef5652fae32a5310c742f38b1ff2f7fe9c20d718d93de944d5e
Jul 06 22:27:35.628831 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.628785    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:35.628937 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.628919    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:35.628993 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:35.628929    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:35.628993 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:35.628990    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:37.628969867 +0000 UTC m=+39.436716911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:35.629091 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:35.629044    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:35.629091 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:35.629058    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:35.629181 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:35.629107    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:27:37.629092055 +0000 UTC m=+39.436839098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:35.681604 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.681560    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:27:35.681754 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.681562    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:27:35.681754 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.681750    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:27:35.685240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.685219    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 22:27:35.686194 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.686163    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 22:27:35.686302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.686196    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 22:27:35.686302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.686247    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kgqgb\""
Jul 06 22:27:35.686302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.686260    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69kbf\""
Jul 06 22:27:35.686302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.686268    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 22:27:35.860879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.860842    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5k28" event={"ID":"db83e1fc-3963-4eb0-80ae-e9ccd2a18711","Type":"ContainerStarted","Data":"00ed4af4f4108ef5652fae32a5310c742f38b1ff2f7fe9c20d718d93de944d5e"}
Jul 06 22:27:35.863488 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.863465    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="e468a54c7b43ad0b1f28a88bdb7986700f8b6966189420a7e6fe99e8d5bdfae1" exitCode=0
Jul 06 22:27:35.863582 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:35.863496    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"e468a54c7b43ad0b1f28a88bdb7986700f8b6966189420a7e6fe99e8d5bdfae1"}
Jul 06 22:27:36.869196 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:36.869162    2589 generic.go:356] "Generic (PLEG): container finished" podID="1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1" containerID="307aa708221db14d1be96d0beb067c81cefe4f13cd56bab7a85d7f04436fda39" exitCode=0
Jul 06 22:27:36.869603 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:36.869213    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerDied","Data":"307aa708221db14d1be96d0beb067c81cefe4f13cd56bab7a85d7f04436fda39"}
Jul 06 22:27:37.638722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.638682    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:37.644146 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.644116    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:37.644258 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.644159    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:37.644307 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:37.644266    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:37.644307 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:37.644280    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:37.644307 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:37.644293    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:37.644423 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:37.644319    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:41.644304857 +0000 UTC m=+43.452051901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:37.644423 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:37.644339    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:27:41.644324596 +0000 UTC m=+43.452071654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:37.720922 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.720884    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:37.790031 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.787988    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:37.875232 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.875197    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shmn7" event={"ID":"1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1","Type":"ContainerStarted","Data":"1b1396c186c9182195778424262c2ab4106fb7212786bb6b73284a2c8358bdc5"}
Jul 06 22:27:37.899005 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:37.898905    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-shmn7" podStartSLOduration=7.290461141 podStartE2EDuration="38.898887266s" totalImagesPullingTime="31.608426125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:37.897066563 +0000 UTC m=+39.704813642" watchObservedRunningTime="2026-07-06 22:27:37.898887266 +0000 UTC m=+39.706634333"
Jul 06 22:27:38.042898 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:38.042865    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:38.111922 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:38.111877    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:38.879374 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:38.879070    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5k28" event={"ID":"db83e1fc-3963-4eb0-80ae-e9ccd2a18711","Type":"ContainerStarted","Data":"0bfaf3fc57aa00f18b2d1d11554609d1749b0a266fc543c8a005fa2f0cead2c8"}
Jul 06 22:27:41.671959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:41.671920    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:41.671959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:41.671959    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:41.672387 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:41.672059    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:41.672387 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:41.672059    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:41.672387 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:41.672125    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:49.67210989 +0000 UTC m=+51.479856934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:41.672387 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:41.672069    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:41.672387 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:41.672199    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:27:49.672188186 +0000 UTC m=+51.479935230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:45.476641 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.476602    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:45.600104 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.600068    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:45.689097 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.689051    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:45.789921 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.789875    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:45.889607 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.889573    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:45.998758 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:45.998725    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:49.728868 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:49.728826    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:27:49.728868 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:49.728869    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:27:49.729457 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:49.728966    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:27:49.729457 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:49.728975    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:27:49.729457 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:49.728972    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:27:49.729457 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:49.729021    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.729008508 +0000 UTC m=+67.536755552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:27:49.729457 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:49.729034    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.72902836 +0000 UTC m=+67.536775404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:27:52.622250 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:52.622187    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:52.722226 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:52.722186    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:53.326162 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:53.326123    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:53.401935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:53.401904    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:53.687750 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:53.687658    2589 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log" limit=1024
Jul 06 22:27:57.733210 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.733156    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q5k28" podStartSLOduration=21.736104414 podStartE2EDuration="24.733126082s" totalImagesPullingTime="2.997021668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:38.896891981 +0000 UTC m=+40.704639048" watchObservedRunningTime="2026-07-06 22:27:57.733126082 +0000 UTC m=+59.540873148"
Jul 06 22:27:57.733791 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.733703    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-59czs"]
Jul 06 22:27:57.736860 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.736839    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86f8c84d9f-hc9zh"]
Jul 06 22:27:57.736982 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.736949    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.739310 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.739293    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.739472 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.739452    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dwh2v\""
Jul 06 22:27:57.739649 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.739504    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 22:27:57.739879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.739861    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 22:27:57.740340 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.740322    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 22:27:57.740787 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.740768    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 22:27:57.742879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.742859    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 22:27:57.742990 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.742878    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 22:27:57.742990 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.742956    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 22:27:57.742990 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.742960    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 22:27:57.743224 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.743209    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 22:27:57.743318 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.743248    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkctc\""
Jul 06 22:27:57.743407 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.743334    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 22:27:57.746726 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.746709    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 22:27:57.747015 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.746996    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-59czs"]
Jul 06 22:27:57.754171 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.754144    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86f8c84d9f-hc9zh"]
Jul 06 22:27:57.789255 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789225    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-tmp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789255 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789256    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-snapshots\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789495 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789277    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7jsp\" (UniqueName: \"kubernetes.io/projected/ba34b5c3-179e-4410-b409-c746e410653f-kube-api-access-x7jsp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789495 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789341    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.789495 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789384    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789495 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789426    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789495 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789492    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34b5c3-179e-4410-b409-c746e410653f-serving-cert\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.789687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789519    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-default-certificate\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.789687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789551    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.789687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789589    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-stats-auth\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.789687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.789610    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfc9\" (UniqueName: \"kubernetes.io/projected/b1383232-1de0-4f53-b63f-4dfb4d42dd96-kube-api-access-8jfc9\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.833717 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.833681    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"]
Jul 06 22:27:57.836499 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.836480    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.839092 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.839073    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 22:27:57.840272 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.840255    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 22:27:57.840364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.840267    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 22:27:57.840364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.840308    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 22:27:57.840364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.840267    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rqq6m\""
Jul 06 22:27:57.850561 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.850538    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"]
Jul 06 22:27:57.890136 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890107    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.890266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890141    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.890266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890185    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-default-certificate\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.890266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890211    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.890266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890242    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-tmp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890263    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-snapshots\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:57.890306    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:58.390283161 +0000 UTC m=+60.198030230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:57.890347    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:57.890400    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:58.390387724 +0000 UTC m=+60.198134767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890427    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7jsp\" (UniqueName: \"kubernetes.io/projected/ba34b5c3-179e-4410-b409-c746e410653f-kube-api-access-x7jsp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890467    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890492    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxsd6\" (UniqueName: \"kubernetes.io/projected/e7fe07aa-0892-406a-b47d-07084117c770-kube-api-access-sxsd6\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890516    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890549    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7fe07aa-0892-406a-b47d-07084117c770-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890617    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34b5c3-179e-4410-b409-c746e410653f-serving-cert\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.890736 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890694    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-stats-auth\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.891336 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890742    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfc9\" (UniqueName: \"kubernetes.io/projected/b1383232-1de0-4f53-b63f-4dfb4d42dd96-kube-api-access-8jfc9\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.891336 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890836    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-tmp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.891336 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.890901    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ba34b5c3-179e-4410-b409-c746e410653f-snapshots\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.891336 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.891177    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.891536 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.891433    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34b5c3-179e-4410-b409-c746e410653f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.894167 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.894147    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34b5c3-179e-4410-b409-c746e410653f-serving-cert\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.894314 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.894296    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-stats-auth\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.894372 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.894312    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-default-certificate\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.899046 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.899028    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7jsp\" (UniqueName: \"kubernetes.io/projected/ba34b5c3-179e-4410-b409-c746e410653f-kube-api-access-x7jsp\") pod \"insights-operator-5c847dcfc4-59czs\" (UID: \"ba34b5c3-179e-4410-b409-c746e410653f\") " pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:57.900029 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.900009    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfc9\" (UniqueName: \"kubernetes.io/projected/b1383232-1de0-4f53-b63f-4dfb4d42dd96-kube-api-access-8jfc9\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:57.991990 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.991891    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.992164 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.992013    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxsd6\" (UniqueName: \"kubernetes.io/projected/e7fe07aa-0892-406a-b47d-07084117c770-kube-api-access-sxsd6\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.992164 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:57.992033    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:27:57.992164 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.992047    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7fe07aa-0892-406a-b47d-07084117c770-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:57.992164 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:57.992112    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:58.492094468 +0000 UTC m=+60.299841529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:27:57.992786 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:57.992762    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7fe07aa-0892-406a-b47d-07084117c770-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:58.001343 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.001324    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxsd6\" (UniqueName: \"kubernetes.io/projected/e7fe07aa-0892-406a-b47d-07084117c770-kube-api-access-sxsd6\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:58.048483 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.048448    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-59czs"
Jul 06 22:27:58.187723 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.187695    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-59czs"]
Jul 06 22:27:58.190499 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:27:58.190471    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34b5c3_179e_4410_b409_c746e410653f.slice/crio-ce901682b5dfc583cfa04424e8a0f27082602838f9ed4b6674f23149fab808ab WatchSource:0}: Error finding container ce901682b5dfc583cfa04424e8a0f27082602838f9ed4b6674f23149fab808ab: Status 404 returned error can't find the container with id ce901682b5dfc583cfa04424e8a0f27082602838f9ed4b6674f23149fab808ab
Jul 06 22:27:58.395235 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.395199    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:58.395402 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.395278    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:58.395402 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:58.395370    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:59.395356214 +0000 UTC m=+61.203103277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:27:58.395480 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:58.395419    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:27:58.395480 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:58.395475    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:59.395461729 +0000 UTC m=+61.203208772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:27:58.495653 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.495617    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:58.495836 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:58.495767    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:27:58.495876 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:58.495841    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:27:59.495826205 +0000 UTC m=+61.303573272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:27:58.927638 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:58.927594    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-59czs" event={"ID":"ba34b5c3-179e-4410-b409-c746e410653f","Type":"ContainerStarted","Data":"ce901682b5dfc583cfa04424e8a0f27082602838f9ed4b6674f23149fab808ab"}
Jul 06 22:27:59.402661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:59.402622    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:59.402855 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:59.402733    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:27:59.402960 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:59.402901    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:01.402877931 +0000 UTC m=+63.210624975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:27:59.402960 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:59.402901    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:27:59.403085 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:59.402992    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:01.402983615 +0000 UTC m=+63.210730660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:27:59.503568 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:27:59.503526    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:27:59.503761 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:59.503715    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:27:59.503856 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:27:59.503792    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:01.503772482 +0000 UTC m=+63.311519527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:00.859615 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:00.859589    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnbhg"
Jul 06 22:28:00.933977 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:00.933943    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-59czs" event={"ID":"ba34b5c3-179e-4410-b409-c746e410653f","Type":"ContainerStarted","Data":"cf420b6c4f1747f38ffc1da2124cf759e84fd9293fe1f8901377d509949134d4"}
Jul 06 22:28:00.950991 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:00.950937    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-59czs" podStartSLOduration=1.935194708 podStartE2EDuration="3.950920696s" totalImagesPullingTime="2.015725988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:00.950283798 +0000 UTC m=+62.758030864" watchObservedRunningTime="2026-07-06 22:28:00.950920696 +0000 UTC m=+62.758667761"
Jul 06 22:28:01.420428 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:01.420387    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:01.420615 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:01.420489    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:01.420615 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:01.420557    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.420534873 +0000 UTC m=+67.228281917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:28:01.420615 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:01.420608    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:28:01.420722 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:01.420665    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.420649119 +0000 UTC m=+67.228396166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:28:01.521349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:01.521308    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:01.521532 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:01.521484    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:01.521617 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:01.521567    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.521545473 +0000 UTC m=+67.329292537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:02.051046 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.051013    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hk86v"]
Jul 06 22:28:02.054346 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.054301    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.058478 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.058454    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 22:28:02.058592 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.058454    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcxxp\""
Jul 06 22:28:02.058592 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.058461    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 22:28:02.080280 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.080246    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk86v"]
Jul 06 22:28:02.126755 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.126715    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-crio-socket\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.126944 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.126774    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.126944 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.126875    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-data-volume\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.127063 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.126966    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.127063 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.127017    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vqk8\" (UniqueName: \"kubernetes.io/projected/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-api-access-4vqk8\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228343 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228298    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-crio-socket\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228343 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228351    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228557 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.228412    2589 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:28:02.228557 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228432    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-crio-socket\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228557 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.228460    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:02.728446862 +0000 UTC m=+64.536193905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : configmap "kube-rbac-proxy" not found
Jul 06 22:28:02.228557 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228521    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-data-volume\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228752 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228568    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228752 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228599    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vqk8\" (UniqueName: \"kubernetes.io/projected/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-api-access-4vqk8\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.228891 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.228744    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:02.228891 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.228833    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:02.728792707 +0000 UTC m=+64.536539753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:02.228891 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.228854    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-data-volume\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.237670 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.237649    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vqk8\" (UniqueName: \"kubernetes.io/projected/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-api-access-4vqk8\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.732747 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.732711    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.732935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:02.732791    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:02.732935 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.732874    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:02.732935 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.732900    2589 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:28:02.732935 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.732932    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:03.732918402 +0000 UTC m=+65.540665448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:02.733070 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:02.732947    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:03.73294062 +0000 UTC m=+65.540687663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : configmap "kube-rbac-proxy" not found
Jul 06 22:28:03.455699 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:03.455670    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xf8ms_951bc210-4e3a-4d52-b73f-b6e5b0da6a78/dns-node-resolver/0.log"
Jul 06 22:28:03.742123 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:03.742038    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:03.742123 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:03.742121    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:03.742345 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:03.742179    2589 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:28:03.742345 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:03.742234    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:03.742345 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:03.742255    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.742235746 +0000 UTC m=+67.549982812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : configmap "kube-rbac-proxy" not found
Jul 06 22:28:03.742345 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:03.742286    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:05.742273499 +0000 UTC m=+67.550020542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:03.855861 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:03.855833    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwh7w_bd54723d-9285-4271-a148-3dede3060239/node-ca/0.log"
Jul 06 22:28:04.447228 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.447192    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:28:04.450065 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.450045    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 22:28:04.460663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.460639    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 22:28:04.470498 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.470470    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffj9\" (UniqueName: \"kubernetes.io/projected/cdd25c4c-695f-4ace-b411-2910b4c0e210-kube-api-access-rffj9\") pod \"network-check-target-sx49d\" (UID: \"cdd25c4c-695f-4ace-b411-2910b4c0e210\") " pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:28:04.501163 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.501142    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69kbf\""
Jul 06 22:28:04.508705 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.508689    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:28:04.548180 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.548149    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:28:04.548343 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.548199    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:28:04.550706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.550681    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 22:28:04.550916 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.550897    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 22:28:04.558901 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:04.558878    2589 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 22:28:04.558998 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:04.558985    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs podName:0066e2d4-dea7-4dc7-91df-9722a09761d1 nodeName:}" failed. No retries permitted until 2026-07-06 22:29:08.558960722 +0000 UTC m=+130.366707782 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs") pod "network-metrics-daemon-d76mt" (UID: "0066e2d4-dea7-4dc7-91df-9722a09761d1") : secret "metrics-daemon-secret" not found
Jul 06 22:28:04.561063 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.561040    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f71a1ac-fa08-4e66-8cc4-74e402b99619-original-pull-secret\") pod \"global-pull-secret-syncer-tljfq\" (UID: \"6f71a1ac-fa08-4e66-8cc4-74e402b99619\") " pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:28:04.628382 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.628307    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sx49d"]
Jul 06 22:28:04.630842 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:04.630792    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd25c4c_695f_4ace_b411_2910b4c0e210.slice/crio-a8c7293e5f206f32c8b1431a3c941abd3efe5d6a04ddad82e20525d12b9a7419 WatchSource:0}: Error finding container a8c7293e5f206f32c8b1431a3c941abd3efe5d6a04ddad82e20525d12b9a7419: Status 404 returned error can't find the container with id a8c7293e5f206f32c8b1431a3c941abd3efe5d6a04ddad82e20525d12b9a7419
Jul 06 22:28:04.654220 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.654202    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5k28_db83e1fc-3963-4eb0-80ae-e9ccd2a18711/serve-healthcheck-canary/0.log"
Jul 06 22:28:04.792136 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.792100    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tljfq"
Jul 06 22:28:04.914532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.914504    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tljfq"]
Jul 06 22:28:04.917393 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:04.917367    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f71a1ac_fa08_4e66_8cc4_74e402b99619.slice/crio-1777b92f8346fd54ee6daad48f7fbc9b8ecca2bee8543f24025a6c2aeb03c592 WatchSource:0}: Error finding container 1777b92f8346fd54ee6daad48f7fbc9b8ecca2bee8543f24025a6c2aeb03c592: Status 404 returned error can't find the container with id 1777b92f8346fd54ee6daad48f7fbc9b8ecca2bee8543f24025a6c2aeb03c592
Jul 06 22:28:04.944177 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.944145    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tljfq" event={"ID":"6f71a1ac-fa08-4e66-8cc4-74e402b99619","Type":"ContainerStarted","Data":"1777b92f8346fd54ee6daad48f7fbc9b8ecca2bee8543f24025a6c2aeb03c592"}
Jul 06 22:28:04.945215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:04.945191    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sx49d" event={"ID":"cdd25c4c-695f-4ace-b411-2910b4c0e210","Type":"ContainerStarted","Data":"a8c7293e5f206f32c8b1431a3c941abd3efe5d6a04ddad82e20525d12b9a7419"}
Jul 06 22:28:05.456439 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.456401    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:05.456633 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.456509    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:05.456633 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.456577    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:28:05.456753 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.456639    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:13.456619601 +0000 UTC m=+75.264366645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:28:05.456753 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.456657    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:13.456648579 +0000 UTC m=+75.264395625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:28:05.557190 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.557157    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:05.557604 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.557289    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:05.557604 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.557359    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:13.557342838 +0000 UTC m=+75.365089883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:05.759044 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.758948    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:05.759044 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.759005    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.759088    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759118    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:05.759134    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759188    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:09.759167186 +0000 UTC m=+71.566914240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759194    2589 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759228    2589 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759239    2589 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6c7f9795-zttrt: secret "image-registry-tls" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759242    2589 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:28:05.759260 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759256    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls podName:8142f9a7-01b0-4927-aa2b-bf431091a0c5 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:37.759238764 +0000 UTC m=+99.566985821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls") pod "dns-default-x9k4c" (UID: "8142f9a7-01b0-4927-aa2b-bf431091a0c5") : secret "dns-default-metrics-tls" not found
Jul 06 22:28:05.759708 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759274    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls podName:3ac92b53-bc56-4659-8282-65ab2e71f9cc nodeName:}" failed. No retries permitted until 2026-07-06 22:28:37.759263627 +0000 UTC m=+99.567010671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls") pod "image-registry-5f6c7f9795-zttrt" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc") : secret "image-registry-tls" not found
Jul 06 22:28:05.759708 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:05.759290    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:09.759281492 +0000 UTC m=+71.567028538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : configmap "kube-rbac-proxy" not found
Jul 06 22:28:08.958477 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:08.958431    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sx49d" event={"ID":"cdd25c4c-695f-4ace-b411-2910b4c0e210","Type":"ContainerStarted","Data":"2bd156b6b83d5027158fc7dda0e75a55a409aaa503404c8dd7019612662111b3"}
Jul 06 22:28:08.958959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:08.958600    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:28:08.982631 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:08.982570    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sx49d" podStartSLOduration=66.429523794 podStartE2EDuration="1m9.982554445s" totalImagesPullingTime="3.553030651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:08.982084017 +0000 UTC m=+70.789831084" watchObservedRunningTime="2026-07-06 22:28:08.982554445 +0000 UTC m=+70.790301510"
Jul 06 22:28:09.794915 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:09.794891    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:09.795009 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:09.794967    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:09.795062 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:09.795035    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:09.795099 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:09.795064    2589 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 22:28:09.795099 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:09.795086    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:17.795070536 +0000 UTC m=+79.602817585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:09.795174 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:09.795104    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:17.795095293 +0000 UTC m=+79.602842337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : configmap "kube-rbac-proxy" not found
Jul 06 22:28:09.962610 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:09.962518    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tljfq" event={"ID":"6f71a1ac-fa08-4e66-8cc4-74e402b99619","Type":"ContainerStarted","Data":"9d9fdbebfd814e63d53b74dda87c2ef274d1873bfb661cf5abcf1590ce2e9612"}
Jul 06 22:28:09.978579 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:09.978530    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tljfq" podStartSLOduration=66.20196114 podStartE2EDuration="1m10.978514021s" totalImagesPullingTime="4.776552881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:09.977697944 +0000 UTC m=+71.785445012" watchObservedRunningTime="2026-07-06 22:28:09.978514021 +0000 UTC m=+71.786261086"
Jul 06 22:28:13.525999 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:13.525955    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:13.526408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:13.526032    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:13.526408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:13.526131    2589 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 22:28:13.526408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:13.526142    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:29.526121053 +0000 UTC m=+91.333868097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : configmap references non-existent config key: service-ca.crt
Jul 06 22:28:13.526408 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:13.526171    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs podName:b1383232-1de0-4f53-b63f-4dfb4d42dd96 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:29.526160709 +0000 UTC m=+91.333907752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs") pod "router-default-86f8c84d9f-hc9zh" (UID: "b1383232-1de0-4f53-b63f-4dfb4d42dd96") : secret "router-metrics-certs-default" not found
Jul 06 22:28:13.627098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:13.627023    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:13.627257 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:13.627167    2589 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:13.627257 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:13.627229    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls podName:e7fe07aa-0892-406a-b47d-07084117c770 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:29.627213762 +0000 UTC m=+91.434960819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gl6tj" (UID: "e7fe07aa-0892-406a-b47d-07084117c770") : secret "cluster-monitoring-operator-tls" not found
Jul 06 22:28:17.862541 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:17.862509    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:17.862930 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:17.862603    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:17.862930 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:17.862657    2589 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:17.862930 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:17.862724    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls podName:1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea nodeName:}" failed. No retries permitted until 2026-07-06 22:28:33.862707144 +0000 UTC m=+95.670454188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk86v" (UID: "1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea") : secret "insights-runtime-extractor-tls" not found
Jul 06 22:28:17.863099 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:17.863083    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:18.047769 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.047736    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wgkct"]
Jul 06 22:28:18.052091 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.052076    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.054690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.054667    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 22:28:18.054839 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.054668    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 22:28:18.055654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.055636    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 22:28:18.055722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.055682    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 22:28:18.055722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.055708    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ckmfg\""
Jul 06 22:28:18.063104 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.063083    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wgkct"]
Jul 06 22:28:18.164111 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.164029    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-key\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.164264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.164111    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-cabundle\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.164264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.164136    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv7m6\" (UniqueName: \"kubernetes.io/projected/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-kube-api-access-dv7m6\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.264476 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.264445    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-key\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.264597 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.264538    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-cabundle\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.264597 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.264567    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv7m6\" (UniqueName: \"kubernetes.io/projected/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-kube-api-access-dv7m6\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.265292 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.265267    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-cabundle\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.266795 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.266770    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-signing-key\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.276698 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.276674    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv7m6\" (UniqueName: \"kubernetes.io/projected/7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5-kube-api-access-dv7m6\") pod \"service-ca-758f599c5-wgkct\" (UID: \"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5\") " pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.360874 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.360843    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wgkct"
Jul 06 22:28:18.481884 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.481855    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wgkct"]
Jul 06 22:28:18.484599 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:18.484554    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0e31da_0d56_4ce5_a0fd_5b99cc1fa3f5.slice/crio-18de5922b29cd4896efe511ca90c8a1e8939f486517db861af367151ce5c609d WatchSource:0}: Error finding container 18de5922b29cd4896efe511ca90c8a1e8939f486517db861af367151ce5c609d: Status 404 returned error can't find the container with id 18de5922b29cd4896efe511ca90c8a1e8939f486517db861af367151ce5c609d
Jul 06 22:28:18.985074 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:18.985032    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wgkct" event={"ID":"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5","Type":"ContainerStarted","Data":"18de5922b29cd4896efe511ca90c8a1e8939f486517db861af367151ce5c609d"}
Jul 06 22:28:20.992426 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:20.992388    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wgkct" event={"ID":"7c0e31da-0d56-4ce5-a0fd-5b99cc1fa3f5","Type":"ContainerStarted","Data":"870d52e6ef077ceb005a11993c7162e570b34aed8e1b26e3191feff58d248d51"}
Jul 06 22:28:21.009015 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:21.008971    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-wgkct" podStartSLOduration=1.075853271 podStartE2EDuration="3.008957316s" totalImagesPullingTime="1.933104045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:21.007285796 +0000 UTC m=+82.815032862" watchObservedRunningTime="2026-07-06 22:28:21.008957316 +0000 UTC m=+82.816704386"
Jul 06 22:28:29.558367 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.558326    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:29.558781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.558436    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:29.559056 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.559036    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1383232-1de0-4f53-b63f-4dfb4d42dd96-service-ca-bundle\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:29.560693 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.560671    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1383232-1de0-4f53-b63f-4dfb4d42dd96-metrics-certs\") pod \"router-default-86f8c84d9f-hc9zh\" (UID: \"b1383232-1de0-4f53-b63f-4dfb4d42dd96\") " pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:29.658858 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.658823    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:29.661160 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.661131    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7fe07aa-0892-406a-b47d-07084117c770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gl6tj\" (UID: \"e7fe07aa-0892-406a-b47d-07084117c770\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:29.859693 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.856468    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkctc\""
Jul 06 22:28:29.863302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.863280    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:29.949225 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.949192    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rqq6m\""
Jul 06 22:28:29.957294 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.957269    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"
Jul 06 22:28:29.994601 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:29.994515    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86f8c84d9f-hc9zh"]
Jul 06 22:28:29.996587 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:29.996559    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1383232_1de0_4f53_b63f_4dfb4d42dd96.slice/crio-70cc1eae47e47f725599a2834d0e56dec681df5c7cc4172b2a5d31069b50b5fe WatchSource:0}: Error finding container 70cc1eae47e47f725599a2834d0e56dec681df5c7cc4172b2a5d31069b50b5fe: Status 404 returned error can't find the container with id 70cc1eae47e47f725599a2834d0e56dec681df5c7cc4172b2a5d31069b50b5fe
Jul 06 22:28:30.025760 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:30.025722    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh" event={"ID":"b1383232-1de0-4f53-b63f-4dfb4d42dd96","Type":"ContainerStarted","Data":"70cc1eae47e47f725599a2834d0e56dec681df5c7cc4172b2a5d31069b50b5fe"}
Jul 06 22:28:30.098359 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:30.098317    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj"]
Jul 06 22:28:30.101222 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:30.101195    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fe07aa_0892_406a_b47d_07084117c770.slice/crio-37563f75de89d32593fa1ec3321523db850a85361a4a15922bd86ff317ccb1b4 WatchSource:0}: Error finding container 37563f75de89d32593fa1ec3321523db850a85361a4a15922bd86ff317ccb1b4: Status 404 returned error can't find the container with id 37563f75de89d32593fa1ec3321523db850a85361a4a15922bd86ff317ccb1b4
Jul 06 22:28:31.031481 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:31.031338    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh" event={"ID":"b1383232-1de0-4f53-b63f-4dfb4d42dd96","Type":"ContainerStarted","Data":"03192a7cdbb718b48b9b01a902cbb688aaa3883eb4a81e5280c613f2d23a66d9"}
Jul 06 22:28:31.032621 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:31.032598    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj" event={"ID":"e7fe07aa-0892-406a-b47d-07084117c770","Type":"ContainerStarted","Data":"37563f75de89d32593fa1ec3321523db850a85361a4a15922bd86ff317ccb1b4"}
Jul 06 22:28:31.054240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:31.054188    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh" podStartSLOduration=34.054169588 podStartE2EDuration="34.054169588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:31.05328834 +0000 UTC m=+92.861035406" watchObservedRunningTime="2026-07-06 22:28:31.054169588 +0000 UTC m=+92.861916655"
Jul 06 22:28:31.863892 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:31.863860    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:31.866389 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:31.866367    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:32.040467 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:32.040433    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj" event={"ID":"e7fe07aa-0892-406a-b47d-07084117c770","Type":"ContainerStarted","Data":"7271410a98d72c59b2eb2d4598cd03bc65762151eae08486b5e6db94b37ca643"}
Jul 06 22:28:32.040918 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:32.040706    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:32.041839 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:32.041802    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86f8c84d9f-hc9zh"
Jul 06 22:28:32.058260 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:32.058213    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gl6tj" podStartSLOduration=33.314708504 podStartE2EDuration="35.058195186s" totalImagesPullingTime="1.743486682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:32.057679424 +0000 UTC m=+93.865426490" watchObservedRunningTime="2026-07-06 22:28:32.058195186 +0000 UTC m=+93.865942254"
Jul 06 22:28:33.894750 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:33.894699    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:33.896933 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:33.896911    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk86v\" (UID: \"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea\") " pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:34.164767 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:34.164682    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk86v"
Jul 06 22:28:34.289694 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:34.288831    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk86v"]
Jul 06 22:28:34.293290 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:34.293263    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfe7d4d_f04e_4647_a8e2_65bbc1bc85ea.slice/crio-8eb36e4d4d376e2639cd189faeddf79ff0d30644b02bdc751f17e1ce9980e52d WatchSource:0}: Error finding container 8eb36e4d4d376e2639cd189faeddf79ff0d30644b02bdc751f17e1ce9980e52d: Status 404 returned error can't find the container with id 8eb36e4d4d376e2639cd189faeddf79ff0d30644b02bdc751f17e1ce9980e52d
Jul 06 22:28:35.051857 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:35.051782    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk86v" event={"ID":"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea","Type":"ContainerStarted","Data":"8eb36e4d4d376e2639cd189faeddf79ff0d30644b02bdc751f17e1ce9980e52d"}
Jul 06 22:28:37.826082 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.826034    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:28:37.826653 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.826123    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:37.828921 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.828897    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8142f9a7-01b0-4927-aa2b-bf431091a0c5-metrics-tls\") pod \"dns-default-x9k4c\" (UID: \"8142f9a7-01b0-4927-aa2b-bf431091a0c5\") " pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:37.829028 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.828992    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"image-registry-5f6c7f9795-zttrt\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") " pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:28:37.892184 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.892166    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjrqw\""
Jul 06 22:28:37.900338 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.900321    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:28:37.905441 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.905422    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9fkj\""
Jul 06 22:28:37.913546 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:37.913527    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:38.046435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:38.046408    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:28:38.049976 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:38.049949    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac92b53_bc56_4659_8282_65ab2e71f9cc.slice/crio-d9ce22d4a4dd77f6c022e1537447eb48630dd1f89cdbda343a8ee4c5bb173fcf WatchSource:0}: Error finding container d9ce22d4a4dd77f6c022e1537447eb48630dd1f89cdbda343a8ee4c5bb173fcf: Status 404 returned error can't find the container with id d9ce22d4a4dd77f6c022e1537447eb48630dd1f89cdbda343a8ee4c5bb173fcf
Jul 06 22:28:38.058243 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:38.058223    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9k4c"]
Jul 06 22:28:38.061421 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:38.061400    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8142f9a7_01b0_4927_aa2b_bf431091a0c5.slice/crio-0d29c2c7257169d8d79df483621e9688b60e5579747f54dae7b78a346305ea12 WatchSource:0}: Error finding container 0d29c2c7257169d8d79df483621e9688b60e5579747f54dae7b78a346305ea12: Status 404 returned error can't find the container with id 0d29c2c7257169d8d79df483621e9688b60e5579747f54dae7b78a346305ea12
Jul 06 22:28:38.062928 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:38.062837    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" event={"ID":"3ac92b53-bc56-4659-8282-65ab2e71f9cc","Type":"ContainerStarted","Data":"d9ce22d4a4dd77f6c022e1537447eb48630dd1f89cdbda343a8ee4c5bb173fcf"}
Jul 06 22:28:38.064463 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:38.064440    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk86v" event={"ID":"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea","Type":"ContainerStarted","Data":"f9abc8bedb624f18c17885308c7f2c7890ad8fbd83b5b74632acb6d9108435e5"}
Jul 06 22:28:39.073613 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.073515    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk86v" event={"ID":"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea","Type":"ContainerStarted","Data":"37e8b2a4dc08afeaf0e9ef28ae1d1043c0642c68e249ad62a9e6605a54150496"}
Jul 06 22:28:39.076411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.076377    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" event={"ID":"3ac92b53-bc56-4659-8282-65ab2e71f9cc","Type":"ContainerStarted","Data":"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"}
Jul 06 22:28:39.076944 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.076891    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:28:39.079482 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.079457    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9k4c" event={"ID":"8142f9a7-01b0-4927-aa2b-bf431091a0c5","Type":"ContainerStarted","Data":"0d29c2c7257169d8d79df483621e9688b60e5579747f54dae7b78a346305ea12"}
Jul 06 22:28:39.080101 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.079974    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"]
Jul 06 22:28:39.083073 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.082992    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.085509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.085489    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 22:28:39.085618 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.085536    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 22:28:39.085896 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.085868    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-k4wsg\""
Jul 06 22:28:39.086104 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.086087    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 22:28:39.087754 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.087624    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 22:28:39.091361 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.091341    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"]
Jul 06 22:28:39.104682 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.101973    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"]
Jul 06 22:28:39.104682 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.102091    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.104682 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.103711    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"]
Jul 06 22:28:39.106735 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.106709    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 22:28:39.108537 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.108495    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" podStartSLOduration=86.108483879 podStartE2EDuration="1m26.108483879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:39.108122977 +0000 UTC m=+100.915870047" watchObservedRunningTime="2026-07-06 22:28:39.108483879 +0000 UTC m=+100.916230945"
Jul 06 22:28:39.137432 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.137400    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btccv\" (UniqueName: \"kubernetes.io/projected/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-kube-api-access-btccv\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.137582 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.137488    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdded160-9334-45f4-8da8-aafcb073fa5e-tmp\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.137582 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.137524    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxdh\" (UniqueName: \"kubernetes.io/projected/cdded160-9334-45f4-8da8-aafcb073fa5e-kube-api-access-9sxdh\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.137700 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.137605    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cdded160-9334-45f4-8da8-aafcb073fa5e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.137700 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.137632    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.186137 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.186089    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"]
Jul 06 22:28:39.192361 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.192334    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"]
Jul 06 22:28:39.192481 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.192429    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.195295 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.194989    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 22:28:39.195295 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.195155    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zwqk9\""
Jul 06 22:28:39.195295 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.195209    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 22:28:39.196509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.196487    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:39.201046 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.200930    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 22:28:39.205536 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.205142    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cc94q\""
Jul 06 22:28:39.207050 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.206990    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"]
Jul 06 22:28:39.208032 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.207944    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"]
Jul 06 22:28:39.238779 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238740    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9eab8910-1710-4af5-9d9a-4beaad7c03eb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.238964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238783    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6aa5f4db-b816-4b13-9270-4d52a8e092d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-b5rnv\" (UID: \"6aa5f4db-b816-4b13-9270-4d52a8e092d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:39.238964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238830    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9eab8910-1710-4af5-9d9a-4beaad7c03eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.238964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238863    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cdded160-9334-45f4-8da8-aafcb073fa5e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.238964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238888    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.238964 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238959    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btccv\" (UniqueName: \"kubernetes.io/projected/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-kube-api-access-btccv\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.239216 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.238989    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdded160-9334-45f4-8da8-aafcb073fa5e-tmp\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.239216 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.239020    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxdh\" (UniqueName: \"kubernetes.io/projected/cdded160-9334-45f4-8da8-aafcb073fa5e-kube-api-access-9sxdh\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.240098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.240048    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdded160-9334-45f4-8da8-aafcb073fa5e-tmp\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.242194 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.242175    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cdded160-9334-45f4-8da8-aafcb073fa5e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.242290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.242227    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.261673 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.261648    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxdh\" (UniqueName: \"kubernetes.io/projected/cdded160-9334-45f4-8da8-aafcb073fa5e-kube-api-access-9sxdh\") pod \"klusterlet-addon-workmgr-7fd6649d98-tnqdc\" (UID: \"cdded160-9334-45f4-8da8-aafcb073fa5e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.263465 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.263440    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btccv\" (UniqueName: \"kubernetes.io/projected/08adad79-a464-4f71-b2e1-4dd2c75b1ae6-kube-api-access-btccv\") pod \"managed-serviceaccount-addon-agent-5564994794-zprs6\" (UID: \"08adad79-a464-4f71-b2e1-4dd2c75b1ae6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.339911 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.339792    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9eab8910-1710-4af5-9d9a-4beaad7c03eb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.340069 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.339962    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6aa5f4db-b816-4b13-9270-4d52a8e092d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-b5rnv\" (UID: \"6aa5f4db-b816-4b13-9270-4d52a8e092d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:39.340069 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.340009    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9eab8910-1710-4af5-9d9a-4beaad7c03eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.340629 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.340604    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9eab8910-1710-4af5-9d9a-4beaad7c03eb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.342781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.342658    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9eab8910-1710-4af5-9d9a-4beaad7c03eb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8gjmr\" (UID: \"9eab8910-1710-4af5-9d9a-4beaad7c03eb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.342904 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.342842    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6aa5f4db-b816-4b13-9270-4d52a8e092d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-b5rnv\" (UID: \"6aa5f4db-b816-4b13-9270-4d52a8e092d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:39.414206 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.413967    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"
Jul 06 22:28:39.422093 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.421876    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:39.508150 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.508050    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"
Jul 06 22:28:39.515248 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.515204    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:39.588971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.588891    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"]
Jul 06 22:28:39.611777 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.610507    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6"]
Jul 06 22:28:39.621636 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:39.617276    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08adad79_a464_4f71_b2e1_4dd2c75b1ae6.slice/crio-f27e0b4e008ea38caa794022dcebfa97a50a8d2459d5f24cfd59e5836419028b WatchSource:0}: Error finding container f27e0b4e008ea38caa794022dcebfa97a50a8d2459d5f24cfd59e5836419028b: Status 404 returned error can't find the container with id f27e0b4e008ea38caa794022dcebfa97a50a8d2459d5f24cfd59e5836419028b
Jul 06 22:28:39.697616 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.697536    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr"]
Jul 06 22:28:39.700832 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:39.700792    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eab8910_1710_4af5_9d9a_4beaad7c03eb.slice/crio-0b2dc12ddf2a9bf00344e4099040694c136ff3b163151a4c7544c12e25562950 WatchSource:0}: Error finding container 0b2dc12ddf2a9bf00344e4099040694c136ff3b163151a4c7544c12e25562950: Status 404 returned error can't find the container with id 0b2dc12ddf2a9bf00344e4099040694c136ff3b163151a4c7544c12e25562950
Jul 06 22:28:39.716202 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.716175    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"]
Jul 06 22:28:39.719586 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:39.719561    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa5f4db_b816_4b13_9270_4d52a8e092d7.slice/crio-61b207d84976a6ce93f138e5d0b87fee1829d65c6f1ef4096870e566eb76f845 WatchSource:0}: Error finding container 61b207d84976a6ce93f138e5d0b87fee1829d65c6f1ef4096870e566eb76f845: Status 404 returned error can't find the container with id 61b207d84976a6ce93f138e5d0b87fee1829d65c6f1ef4096870e566eb76f845
Jul 06 22:28:39.965743 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:39.965639    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sx49d"
Jul 06 22:28:40.084953 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:40.084898    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr" event={"ID":"9eab8910-1710-4af5-9d9a-4beaad7c03eb","Type":"ContainerStarted","Data":"0b2dc12ddf2a9bf00344e4099040694c136ff3b163151a4c7544c12e25562950"}
Jul 06 22:28:40.086186 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:40.086152    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc" event={"ID":"cdded160-9334-45f4-8da8-aafcb073fa5e","Type":"ContainerStarted","Data":"8dfd7badc022cc50adf07e2682c9e99c1f9aaf62b6754d1b04fd7c15a1e3c89a"}
Jul 06 22:28:40.087567 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:40.087541    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv" event={"ID":"6aa5f4db-b816-4b13-9270-4d52a8e092d7","Type":"ContainerStarted","Data":"61b207d84976a6ce93f138e5d0b87fee1829d65c6f1ef4096870e566eb76f845"}
Jul 06 22:28:40.088869 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:40.088845    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6" event={"ID":"08adad79-a464-4f71-b2e1-4dd2c75b1ae6","Type":"ContainerStarted","Data":"f27e0b4e008ea38caa794022dcebfa97a50a8d2459d5f24cfd59e5836419028b"}
Jul 06 22:28:43.104680 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.104619    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr" event={"ID":"9eab8910-1710-4af5-9d9a-4beaad7c03eb","Type":"ContainerStarted","Data":"6f343832fa5b29d6d2c4870370287795509a69ebbfe0f6621e53a8289d9ba432"}
Jul 06 22:28:43.109710 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.109629    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk86v" event={"ID":"1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea","Type":"ContainerStarted","Data":"6a48263fee3de56a8d0dac56217c5adb6e7e1b91578e9b176b8f71d14fae254e"}
Jul 06 22:28:43.118425 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.117623    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv" event={"ID":"6aa5f4db-b816-4b13-9270-4d52a8e092d7","Type":"ContainerStarted","Data":"3d6f1a32ceb0e3065e8d07b35e8058ff01fc0dc35100435eba30d452ec29b615"}
Jul 06 22:28:43.118425 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.118365    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:43.122100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.119935    2589 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-d559d66d5-b5rnv container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.17:8443/healthz\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body=
Jul 06 22:28:43.122100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.119995    2589 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv" podUID="6aa5f4db-b816-4b13-9270-4d52a8e092d7" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.17:8443/healthz\": dial tcp 10.132.0.17:8443: connect: connection refused"
Jul 06 22:28:43.122100 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.121776    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8gjmr" podStartSLOduration=0.85179423 podStartE2EDuration="4.121758701s" totalImagesPullingTime="3.269964471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:43.12012091 +0000 UTC m=+104.927867986" watchObservedRunningTime="2026-07-06 22:28:43.121758701 +0000 UTC m=+104.929505770"
Jul 06 22:28:43.135700 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.135614    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv" podStartSLOduration=0.880852261 podStartE2EDuration="4.135599157s" totalImagesPullingTime="3.254746896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:43.134159398 +0000 UTC m=+104.941906464" watchObservedRunningTime="2026-07-06 22:28:43.135599157 +0000 UTC m=+104.943346222"
Jul 06 22:28:43.154737 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:43.154285    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hk86v" podStartSLOduration=32.602277846 podStartE2EDuration="41.154261814s" totalImagesPullingTime="8.551983968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:28:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:43.15145286 +0000 UTC m=+104.959199927" watchObservedRunningTime="2026-07-06 22:28:43.154261814 +0000 UTC m=+104.962008881"
Jul 06 22:28:44.126051 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:44.126008    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9k4c" event={"ID":"8142f9a7-01b0-4927-aa2b-bf431091a0c5","Type":"ContainerStarted","Data":"8fcb1e13e5a900fb7f5346507a938ca0a4d82d7b2d40971c68a7bb8145e46190"}
Jul 06 22:28:44.126713 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:44.126069    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9k4c" event={"ID":"8142f9a7-01b0-4927-aa2b-bf431091a0c5","Type":"ContainerStarted","Data":"747f9c5352fc2e6989b99bd00f0ae6c7e71c044e32d76b348e9241930ebd86e9"}
Jul 06 22:28:44.126713 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:44.126512    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:44.131214 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:44.131185    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-b5rnv"
Jul 06 22:28:44.146059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:44.146013    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x9k4c" podStartSLOduration=66.247650289 podStartE2EDuration="1m11.14599881s" totalImagesPullingTime="4.898348521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:44.145135577 +0000 UTC m=+105.952882663" watchObservedRunningTime="2026-07-06 22:28:44.14599881 +0000 UTC m=+105.953745875"
Jul 06 22:28:46.134361 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:46.134321    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6" event={"ID":"08adad79-a464-4f71-b2e1-4dd2c75b1ae6","Type":"ContainerStarted","Data":"28ad469386f6d57f1aa302023b2f06eed3a70cc31874376a0ef79b15d1da0b3c"}
Jul 06 22:28:46.135633 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:46.135602    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc" event={"ID":"cdded160-9334-45f4-8da8-aafcb073fa5e","Type":"ContainerStarted","Data":"7f16a5b8c049047e6b85da870a307271f8cad2b95857a914a1723d76bde27ab3"}
Jul 06 22:28:46.149914 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:46.149875    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5564994794-zprs6" podStartSLOduration=0.862732235 podStartE2EDuration="7.149863631s" totalImagesPullingTime="6.287131396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:46.148791572 +0000 UTC m=+107.956538643" watchObservedRunningTime="2026-07-06 22:28:46.149863631 +0000 UTC m=+107.957610698"
Jul 06 22:28:46.163837 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:46.163731    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc" podStartSLOduration=0.844547471 podStartE2EDuration="7.163714357s" totalImagesPullingTime="6.319166886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:46.163303895 +0000 UTC m=+107.971050952" watchObservedRunningTime="2026-07-06 22:28:46.163714357 +0000 UTC m=+107.971461426"
Jul 06 22:28:47.138615 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:47.138581    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:47.140512 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:47.140493    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd6649d98-tnqdc"
Jul 06 22:28:48.840977 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.840934    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8cstd"]
Jul 06 22:28:48.844914 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.844889    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.849058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.847665    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 22:28:48.849058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.848013    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 22:28:48.849058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.848191    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kml7g\""
Jul 06 22:28:48.849058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.848660    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 22:28:48.849058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.848879    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 22:28:48.922630 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922589    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-sys\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922640    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922670    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22913f42-9365-4902-aa87-5361c8937690-node-exporter-textfile\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922697    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-node-exporter-wtmp\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922720    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvzz\" (UniqueName: \"kubernetes.io/projected/22913f42-9365-4902-aa87-5361c8937690-kube-api-access-znvzz\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922744    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922775    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922798    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-root\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:48.922846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:48.922840    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-metrics-client-ca\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.023822 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.023767    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.023836    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-root\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.023869    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-metrics-client-ca\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.023939    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-sys\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.023971    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024021 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024001    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22913f42-9365-4902-aa87-5361c8937690-node-exporter-textfile\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024032    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-node-exporter-wtmp\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024058    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znvzz\" (UniqueName: \"kubernetes.io/projected/22913f42-9365-4902-aa87-5361c8937690-kube-api-access-znvzz\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024083    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024285 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:49.024210    2589 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 22:28:49.024285 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:28:49.024278    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls podName:22913f42-9365-4902-aa87-5361c8937690 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:49.524261937 +0000 UTC m=+111.332008988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls") pod "node-exporter-8cstd" (UID: "22913f42-9365-4902-aa87-5361c8937690") : secret "node-exporter-tls" not found
Jul 06 22:28:49.024543 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024454    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024782 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024734    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-root\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.024782 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.024738    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-sys\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.025040 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.025014    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22913f42-9365-4902-aa87-5361c8937690-node-exporter-textfile\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.025148 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.025133    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22913f42-9365-4902-aa87-5361c8937690-metrics-client-ca\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.025211 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.025178    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22913f42-9365-4902-aa87-5361c8937690-node-exporter-wtmp\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.027480 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.027448    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.035265 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.035243    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvzz\" (UniqueName: \"kubernetes.io/projected/22913f42-9365-4902-aa87-5361c8937690-kube-api-access-znvzz\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.529717 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.529680    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.532050 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.532026    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22913f42-9365-4902-aa87-5361c8937690-node-exporter-tls\") pod \"node-exporter-8cstd\" (UID: \"22913f42-9365-4902-aa87-5361c8937690\") " pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.757537 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:49.757494    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8cstd"
Jul 06 22:28:49.770042 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:28:49.770000    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22913f42_9365_4902_aa87_5361c8937690.slice/crio-48ed1e5ee4de48de966001f9545e1f296e3d15ec3fbad9896c8bf3435c551d38 WatchSource:0}: Error finding container 48ed1e5ee4de48de966001f9545e1f296e3d15ec3fbad9896c8bf3435c551d38: Status 404 returned error can't find the container with id 48ed1e5ee4de48de966001f9545e1f296e3d15ec3fbad9896c8bf3435c551d38
Jul 06 22:28:50.151370 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:50.151339    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cstd" event={"ID":"22913f42-9365-4902-aa87-5361c8937690","Type":"ContainerStarted","Data":"48ed1e5ee4de48de966001f9545e1f296e3d15ec3fbad9896c8bf3435c551d38"}
Jul 06 22:28:51.156110 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:51.156069    2589 generic.go:356] "Generic (PLEG): container finished" podID="22913f42-9365-4902-aa87-5361c8937690" containerID="93fc64cf88fee299e10efca048fa23eea76336499e8557928d0ae1796bb73f4d" exitCode=0
Jul 06 22:28:51.156488 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:51.156136    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cstd" event={"ID":"22913f42-9365-4902-aa87-5361c8937690","Type":"ContainerDied","Data":"93fc64cf88fee299e10efca048fa23eea76336499e8557928d0ae1796bb73f4d"}
Jul 06 22:28:52.162301 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:52.162263    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cstd" event={"ID":"22913f42-9365-4902-aa87-5361c8937690","Type":"ContainerStarted","Data":"4d953780b1bac55153dbe1dc28c8612eea4478268b7e9b06aa8197db27b4b918"}
Jul 06 22:28:52.162677 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:52.162322    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cstd" event={"ID":"22913f42-9365-4902-aa87-5361c8937690","Type":"ContainerStarted","Data":"da0834dfd281c851d9a3d60c9d190b33167c450f146acd939c2e9a2d942fd7f0"}
Jul 06 22:28:52.183673 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:52.183627    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8cstd" podStartSLOduration=3.174196851 podStartE2EDuration="4.183614576s" totalImagesPullingTime="947.384348ms" totalInitContainerRuntime="62.033377ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:52.181693653 +0000 UTC m=+113.989440719" watchObservedRunningTime="2026-07-06 22:28:52.183614576 +0000 UTC m=+113.991361642"
Jul 06 22:28:55.137554 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:55.137507    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x9k4c"
Jul 06 22:28:57.904645 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:57.904616    2589 patch_prober.go:28] interesting pod/image-registry-5f6c7f9795-zttrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 22:28:57.905015 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:28:57.904665    2589 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 22:29:00.093681 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:00.093643    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:29:02.530019 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:02.529984    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:29:03.138442 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.138406    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:03.143256 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.143239    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.147051 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147028    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qh8lz\""
Jul 06 22:29:03.147051 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147035    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 22:29:03.147240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147167    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 22:29:03.147240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147187    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 22:29:03.147240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147185    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 22:29:03.147402 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147242    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 22:29:03.147402 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147325    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 22:29:03.147476 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.147404    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 22:29:03.152295 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.152272    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:03.240370 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240344    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.240534 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240380    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.240534 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240409    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.240534 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240435    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.240534 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240460    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.240534 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.240487    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf8m\" (UniqueName: \"kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341196    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341240 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341250    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341410 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341284    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341410 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341304    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341410 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341319    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.341410 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.341362    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf8m\" (UniqueName: \"kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.342103 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.342080    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.342213 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.342134    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.342213 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.342151    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.343675 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.343648    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.343756 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.343673    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.351222 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.351201    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf8m\" (UniqueName: \"kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m\") pod \"console-7db6d67865-sngnk\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") " pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.452348 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.452263    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:03.581831 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:03.581781    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:03.584661 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:29:03.584634    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305f6f63_b937_45ba_a2af_ad8ff6aec685.slice/crio-1d5a0641ab29bfaff1546de1735d1117b127c5add00cfefccabd453660c9d8cb WatchSource:0}: Error finding container 1d5a0641ab29bfaff1546de1735d1117b127c5add00cfefccabd453660c9d8cb: Status 404 returned error can't find the container with id 1d5a0641ab29bfaff1546de1735d1117b127c5add00cfefccabd453660c9d8cb
Jul 06 22:29:04.208493 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:04.208455    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db6d67865-sngnk" event={"ID":"305f6f63-b937-45ba-a2af-ad8ff6aec685","Type":"ContainerStarted","Data":"1d5a0641ab29bfaff1546de1735d1117b127c5add00cfefccabd453660c9d8cb"}
Jul 06 22:29:07.220778 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:07.220742    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db6d67865-sngnk" event={"ID":"305f6f63-b937-45ba-a2af-ad8ff6aec685","Type":"ContainerStarted","Data":"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"}
Jul 06 22:29:07.240971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:07.240923    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db6d67865-sngnk" podStartSLOduration=1.393711101 podStartE2EDuration="4.240907568s" totalImagesPullingTime="2.847196467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:07.240143585 +0000 UTC m=+129.047890652" watchObservedRunningTime="2026-07-06 22:29:07.240907568 +0000 UTC m=+129.048654633"
Jul 06 22:29:08.583532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:08.583492    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:29:08.585896 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:08.585873    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0066e2d4-dea7-4dc7-91df-9722a09761d1-metrics-certs\") pod \"network-metrics-daemon-d76mt\" (UID: \"0066e2d4-dea7-4dc7-91df-9722a09761d1\") " pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:29:08.705748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:08.705717    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kgqgb\""
Jul 06 22:29:08.714168 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:08.714148    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d76mt"
Jul 06 22:29:08.837941 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:08.837918    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d76mt"]
Jul 06 22:29:08.840158 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:29:08.840132    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0066e2d4_dea7_4dc7_91df_9722a09761d1.slice/crio-78a5984c9b3d47410e81a46e9ecc1cd282796a44e585f154f54f906108af072f WatchSource:0}: Error finding container 78a5984c9b3d47410e81a46e9ecc1cd282796a44e585f154f54f906108af072f: Status 404 returned error can't find the container with id 78a5984c9b3d47410e81a46e9ecc1cd282796a44e585f154f54f906108af072f
Jul 06 22:29:09.229106 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:09.229024    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d76mt" event={"ID":"0066e2d4-dea7-4dc7-91df-9722a09761d1","Type":"ContainerStarted","Data":"78a5984c9b3d47410e81a46e9ecc1cd282796a44e585f154f54f906108af072f"}
Jul 06 22:29:10.234603 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.234518    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d76mt" event={"ID":"0066e2d4-dea7-4dc7-91df-9722a09761d1","Type":"ContainerStarted","Data":"07e191fcddc3aaec262e3f7ef4b8e348f1f21fc591f3e9b9e46fec8b93de7a62"}
Jul 06 22:29:10.234603 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.234580    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d76mt" event={"ID":"0066e2d4-dea7-4dc7-91df-9722a09761d1","Type":"ContainerStarted","Data":"740009cadb6df34920e6a6eadde381fe8cd7d0c311d02df7cda6bca881985328"}
Jul 06 22:29:10.251664 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.251620    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d76mt" podStartSLOduration=130.250675126 podStartE2EDuration="2m11.251605455s" totalImagesPullingTime="1.000930329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:10.249911927 +0000 UTC m=+132.057658993" watchObservedRunningTime="2026-07-06 22:29:10.251605455 +0000 UTC m=+132.059352559"
Jul 06 22:29:10.283267 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.283238    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:29:10.294328 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.294300    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.296605 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.296581    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:29:10.301584 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.301563    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 22:29:10.398082 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398047    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398098    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398193    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwdl\" (UniqueName: \"kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398233    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398261    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398419 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398350    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.398419 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.398393    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499483 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499400    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwdl\" (UniqueName: \"kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499483 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499436    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499483 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499458    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499761 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499503    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499761 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499534    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499761 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499568    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.499761 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.499594    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.500260 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.500232    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.505420 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.500299    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.505420 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.500771    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.505420 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.500970    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.505420 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.502393    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.505420 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.502530    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.510125 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.510104    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwdl\" (UniqueName: \"kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl\") pod \"console-6f9f64ddcb-nvwr2\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") " pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.604954 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.604920    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:10.826143 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:10.826119    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:29:10.828630 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:29:10.828590    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2594bccb_5cae_4ce5_8747_cd5314ef1b63.slice/crio-877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3 WatchSource:0}: Error finding container 877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3: Status 404 returned error can't find the container with id 877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3
Jul 06 22:29:11.239790 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:11.239691    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f64ddcb-nvwr2" event={"ID":"2594bccb-5cae-4ce5-8747-cd5314ef1b63","Type":"ContainerStarted","Data":"b45bbc94042688a363cd953786587780b669717d71980504a91e6c697f610991"}
Jul 06 22:29:11.239790 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:11.239752    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f64ddcb-nvwr2" event={"ID":"2594bccb-5cae-4ce5-8747-cd5314ef1b63","Type":"ContainerStarted","Data":"877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3"}
Jul 06 22:29:11.257349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:11.257305    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9f64ddcb-nvwr2" podStartSLOduration=1.257291374 podStartE2EDuration="1.257291374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:11.256554096 +0000 UTC m=+133.064301162" watchObservedRunningTime="2026-07-06 22:29:11.257291374 +0000 UTC m=+133.065038440"
Jul 06 22:29:13.453407 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:13.453375    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:13.453871 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:13.453441    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:13.458090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:13.458067    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:14.254959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:14.254934    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:20.605219 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:20.605174    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:20.605696 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:20.605272    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:20.610153 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:20.610130    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:21.279247 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:21.279216    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:29:21.328729 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:21.328041    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:26.294481 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:26.294444    2589 generic.go:356] "Generic (PLEG): container finished" podID="ba34b5c3-179e-4410-b409-c746e410653f" containerID="cf420b6c4f1747f38ffc1da2124cf759e84fd9293fe1f8901377d509949134d4" exitCode=0
Jul 06 22:29:26.294860 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:26.294496    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-59czs" event={"ID":"ba34b5c3-179e-4410-b409-c746e410653f","Type":"ContainerDied","Data":"cf420b6c4f1747f38ffc1da2124cf759e84fd9293fe1f8901377d509949134d4"}
Jul 06 22:29:26.294860 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:26.294839    2589 scope.go:117] "RemoveContainer" containerID="cf420b6c4f1747f38ffc1da2124cf759e84fd9293fe1f8901377d509949134d4"
Jul 06 22:29:27.299247 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.299214    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-59czs" event={"ID":"ba34b5c3-179e-4410-b409-c746e410653f","Type":"ContainerStarted","Data":"240847098e6a1942dab9cc7c00ea4263b3f5ddc2260736715e5d3c1d44764322"}
Jul 06 22:29:27.549579 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.549483    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerName="registry" containerID="cri-o://82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939" gracePeriod=30
Jul 06 22:29:27.802574 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.802516    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:29:27.836549 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836526    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.836706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836564    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.836706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836586    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.836706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836612    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.836706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836648    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.836706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836684    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.837748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836719    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjbhm\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.837748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.836746    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration\") pod \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\" (UID: \"3ac92b53-bc56-4659-8282-65ab2e71f9cc\") "
Jul 06 22:29:27.837748 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.837047    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:29:27.838173 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.838134    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:29:27.839841 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.839773    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:29:27.840716 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.840673    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:29:27.840843 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.840730    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm" (OuterVolumeSpecName: "kube-api-access-rjbhm") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "kube-api-access-rjbhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:29:27.840843 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.840740    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:29:27.840981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.840922    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:29:27.847917 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.847771    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3ac92b53-bc56-4659-8282-65ab2e71f9cc" (UID: "3ac92b53-bc56-4659-8282-65ab2e71f9cc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:29:27.937971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.937937    2589 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ac92b53-bc56-4659-8282-65ab2e71f9cc-ca-trust-extracted\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.937971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.937965    2589 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-certificates\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.937971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.937979    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjbhm\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-kube-api-access-rjbhm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.938195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.937995    2589 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-image-registry-private-configuration\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.938195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.938009    2589 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-bound-sa-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.938195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.938020    2589 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ac92b53-bc56-4659-8282-65ab2e71f9cc-trusted-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.938195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.938031    2589 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ac92b53-bc56-4659-8282-65ab2e71f9cc-installation-pull-secrets\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:27.938195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:27.938042    2589 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ac92b53-bc56-4659-8282-65ab2e71f9cc-registry-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:28.303270 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.303235    2589 generic.go:356] "Generic (PLEG): container finished" podID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerID="82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939" exitCode=0
Jul 06 22:29:28.303690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.303284    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt"
Jul 06 22:29:28.303690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.303301    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" event={"ID":"3ac92b53-bc56-4659-8282-65ab2e71f9cc","Type":"ContainerDied","Data":"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"}
Jul 06 22:29:28.303690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.303344    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6c7f9795-zttrt" event={"ID":"3ac92b53-bc56-4659-8282-65ab2e71f9cc","Type":"ContainerDied","Data":"d9ce22d4a4dd77f6c022e1537447eb48630dd1f89cdbda343a8ee4c5bb173fcf"}
Jul 06 22:29:28.303690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.303363    2589 scope.go:117] "RemoveContainer" containerID="82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"
Jul 06 22:29:28.312509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.312493    2589 scope.go:117] "RemoveContainer" containerID="82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"
Jul 06 22:29:28.312761 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:29:28.312739    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939\": container with ID starting with 82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939 not found: ID does not exist" containerID="82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"
Jul 06 22:29:28.312846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.312772    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939"} err="failed to get container status \"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939\": rpc error: code = NotFound desc = could not find container \"82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939\": container with ID starting with 82d3cf11a995ce32983e5e986a97ad259dabf915459f940cf49410378b376939 not found: ID does not exist"
Jul 06 22:29:28.343154 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.343123    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:29:28.348505 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.348485    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f6c7f9795-zttrt"]
Jul 06 22:29:28.686752 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:28.686675    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" path="/var/lib/kubelet/pods/3ac92b53-bc56-4659-8282-65ab2e71f9cc/volumes"
Jul 06 22:29:46.361271 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.361227    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7db6d67865-sngnk" podUID="305f6f63-b937-45ba-a2af-ad8ff6aec685" containerName="console" containerID="cri-o://b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12" gracePeriod=15
Jul 06 22:29:46.599965 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.599932    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:46.682865 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.682771    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtf8m\" (UniqueName: \"kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.682865 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.682846    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.683090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.682879    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.683090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.682913    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.683090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.682983    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.683090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.683008    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config\") pod \"305f6f63-b937-45ba-a2af-ad8ff6aec685\" (UID: \"305f6f63-b937-45ba-a2af-ad8ff6aec685\") "
Jul 06 22:29:46.683361 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.683296    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:29:46.683433 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.683404    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca" (OuterVolumeSpecName: "service-ca") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:29:46.683479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.683443    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config" (OuterVolumeSpecName: "console-config") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:29:46.685234 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.685194    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:29:46.685360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.685340    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:29:46.685422 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.685381    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m" (OuterVolumeSpecName: "kube-api-access-vtf8m") pod "305f6f63-b937-45ba-a2af-ad8ff6aec685" (UID: "305f6f63-b937-45ba-a2af-ad8ff6aec685"). InnerVolumeSpecName "kube-api-access-vtf8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:29:46.784312 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784276    2589 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:46.784312 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784305    2589 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:46.784312 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784314    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtf8m\" (UniqueName: \"kubernetes.io/projected/305f6f63-b937-45ba-a2af-ad8ff6aec685-kube-api-access-vtf8m\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:46.784592 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784328    2589 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305f6f63-b937-45ba-a2af-ad8ff6aec685-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:46.784592 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784343    2589 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:46.784592 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:46.784356    2589 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305f6f63-b937-45ba-a2af-ad8ff6aec685-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:29:47.380009 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.379970    2589 generic.go:356] "Generic (PLEG): container finished" podID="305f6f63-b937-45ba-a2af-ad8ff6aec685" containerID="b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12" exitCode=0
Jul 06 22:29:47.380383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.380013    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db6d67865-sngnk"
Jul 06 22:29:47.380383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.380040    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db6d67865-sngnk" event={"ID":"305f6f63-b937-45ba-a2af-ad8ff6aec685","Type":"ContainerDied","Data":"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"}
Jul 06 22:29:47.380383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.380082    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db6d67865-sngnk" event={"ID":"305f6f63-b937-45ba-a2af-ad8ff6aec685","Type":"ContainerDied","Data":"1d5a0641ab29bfaff1546de1735d1117b127c5add00cfefccabd453660c9d8cb"}
Jul 06 22:29:47.380383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.380103    2589 scope.go:117] "RemoveContainer" containerID="b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"
Jul 06 22:29:47.388403 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.388366    2589 scope.go:117] "RemoveContainer" containerID="b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"
Jul 06 22:29:47.388672 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:29:47.388652    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12\": container with ID starting with b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12 not found: ID does not exist" containerID="b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"
Jul 06 22:29:47.388722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.388683    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12"} err="failed to get container status \"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12\": rpc error: code = NotFound desc = could not find container \"b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12\": container with ID starting with b0bbe55b299a82248cb7e8386ee35f139a7cab75180e50b428e13afd4b985c12 not found: ID does not exist"
Jul 06 22:29:47.396996 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.396974    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:47.400010 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:47.399992    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db6d67865-sngnk"]
Jul 06 22:29:48.687045 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:29:48.687006    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305f6f63-b937-45ba-a2af-ad8ff6aec685" path="/var/lib/kubelet/pods/305f6f63-b937-45ba-a2af-ad8ff6aec685/volumes"
Jul 06 22:30:22.519872 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.519839    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520107    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerName="registry"
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520117    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerName="registry"
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520126    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305f6f63-b937-45ba-a2af-ad8ff6aec685" containerName="console"
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520132    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="305f6f63-b937-45ba-a2af-ad8ff6aec685" containerName="console"
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520175    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="305f6f63-b937-45ba-a2af-ad8ff6aec685" containerName="console"
Jul 06 22:30:22.520321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.520183    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac92b53-bc56-4659-8282-65ab2e71f9cc" containerName="registry"
Jul 06 22:30:22.522924 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.522903    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.533977 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.533954    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:30:22.650285 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650245    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650299    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650330    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650360    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650376    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650395    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7f9w\" (UniqueName: \"kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.650450 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.650438    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751211 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751174    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751211 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751211    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751234    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751249    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751527 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751458    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7f9w\" (UniqueName: \"kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751527 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751507    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.751980 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751950    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.752114 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.751983    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.752114 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.752008    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.752114 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.752091    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.752395 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.752373    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.753827 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.753786    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.754023 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.754006    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.760195 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.760176    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7f9w\" (UniqueName: \"kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w\") pod \"console-6f9d779448-48prk\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") " pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.832546 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.832505    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:22.962562 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:22.962531    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:30:22.965830 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:30:22.965789    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cb8101_8ffd_4691_822b_0c1c6bd77807.slice/crio-a3b65dfcdd108777df70827ccd44681b64b561a0c7bce51f1c067281409bebad WatchSource:0}: Error finding container a3b65dfcdd108777df70827ccd44681b64b561a0c7bce51f1c067281409bebad: Status 404 returned error can't find the container with id a3b65dfcdd108777df70827ccd44681b64b561a0c7bce51f1c067281409bebad
Jul 06 22:30:23.504114 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:23.504081    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d779448-48prk" event={"ID":"d3cb8101-8ffd-4691-822b-0c1c6bd77807","Type":"ContainerStarted","Data":"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"}
Jul 06 22:30:23.504286 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:23.504129    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d779448-48prk" event={"ID":"d3cb8101-8ffd-4691-822b-0c1c6bd77807","Type":"ContainerStarted","Data":"a3b65dfcdd108777df70827ccd44681b64b561a0c7bce51f1c067281409bebad"}
Jul 06 22:30:23.523107 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:23.523059    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9d779448-48prk" podStartSLOduration=1.523043728 podStartE2EDuration="1.523043728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:30:23.52257581 +0000 UTC m=+205.330322876" watchObservedRunningTime="2026-07-06 22:30:23.523043728 +0000 UTC m=+205.330790794"
Jul 06 22:30:32.833259 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:32.833219    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:32.833740 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:32.833283    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:32.837978 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:32.837954    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:33.540952 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:33.540923    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:30:33.578752 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:33.578717    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:30:42.553550 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.553513    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"]
Jul 06 22:30:42.557050 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.557032    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.559535 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.559511    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 22:30:42.559669 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.559575    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnnw4\""
Jul 06 22:30:42.559669 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.559594    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 22:30:42.564094 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.563752    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"]
Jul 06 22:30:42.708438 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.708410    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.708621 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.708455    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.708621 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.708553    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97bvb\" (UniqueName: \"kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.809942 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.809856    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97bvb\" (UniqueName: \"kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.809942 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.809913    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.810124 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.810087    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.810230 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.810213    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.810412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.810394    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.818061 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.818038    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97bvb\" (UniqueName: \"kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.867288 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.867260    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:30:42.989364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:42.989337    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"]
Jul 06 22:30:42.991546 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:30:42.991521    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df925ae_b984_451b_9189_94f13b3ddf6a.slice/crio-64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29 WatchSource:0}: Error finding container 64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29: Status 404 returned error can't find the container with id 64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29
Jul 06 22:30:43.571614 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:43.571575    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerStarted","Data":"64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29"}
Jul 06 22:30:49.598799 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:49.598760    2589 generic.go:356] "Generic (PLEG): container finished" podID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerID="9a71e2e531c54a69adc782496218b0cf2d1fa66f43014ab3a893e6f32355916b" exitCode=0
Jul 06 22:30:49.599250 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:49.598849    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerDied","Data":"9a71e2e531c54a69adc782496218b0cf2d1fa66f43014ab3a893e6f32355916b"}
Jul 06 22:30:52.612595 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:52.612560    2589 generic.go:356] "Generic (PLEG): container finished" podID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerID="36be4ff2357696d476eec61b8a9b69dabaa47e34be7c9066da41feb04f851d6b" exitCode=0
Jul 06 22:30:52.612595 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:52.612598    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerDied","Data":"36be4ff2357696d476eec61b8a9b69dabaa47e34be7c9066da41feb04f851d6b"}
Jul 06 22:30:58.604075 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:58.604027    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f9f64ddcb-nvwr2" podUID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" containerName="console" containerID="cri-o://b45bbc94042688a363cd953786587780b669717d71980504a91e6c697f610991" gracePeriod=15
Jul 06 22:30:59.644113 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.644081    2589 generic.go:356] "Generic (PLEG): container finished" podID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" containerID="b45bbc94042688a363cd953786587780b669717d71980504a91e6c697f610991" exitCode=0
Jul 06 22:30:59.644444 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.644150    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f64ddcb-nvwr2" event={"ID":"2594bccb-5cae-4ce5-8747-cd5314ef1b63","Type":"ContainerDied","Data":"b45bbc94042688a363cd953786587780b669717d71980504a91e6c697f610991"}
Jul 06 22:30:59.644444 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.644195    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f64ddcb-nvwr2" event={"ID":"2594bccb-5cae-4ce5-8747-cd5314ef1b63","Type":"ContainerDied","Data":"877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3"}
Jul 06 22:30:59.644444 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.644210    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="877cf4d947b6c0b06096741e456cdbface6b45afe9fe30b784d2f8533670d5e3"
Jul 06 22:30:59.646156 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.646136    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerStarted","Data":"168809912b9f2bac5d84904b06a186c6fd954e093efb5d66278e769c2b19939e"}
Jul 06 22:30:59.646325 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.646310    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:30:59.663365 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.663289    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" podStartSLOduration=2.132310244 podStartE2EDuration="17.66327523s" totalImagesPullingTime="15.530964986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:30:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:30:59.662354993 +0000 UTC m=+241.470102060" watchObservedRunningTime="2026-07-06 22:30:59.66327523 +0000 UTC m=+241.471022349"
Jul 06 22:30:59.734743 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.734715    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.734743 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.734749    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.734783    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwdl\" (UniqueName: \"kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.734843    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.734944    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735003    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735205 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735053    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert\") pod \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\" (UID: \"2594bccb-5cae-4ce5-8747-cd5314ef1b63\") "
Jul 06 22:30:59.735205 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735175    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config" (OuterVolumeSpecName: "console-config") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:30:59.735205 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735189    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:30:59.735396 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735374    2589 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.735480 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735409    2589 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.735480 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735454    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca" (OuterVolumeSpecName: "service-ca") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:30:59.735583 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.735557    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:30:59.737204 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.737171    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl" (OuterVolumeSpecName: "kube-api-access-9rwdl") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "kube-api-access-9rwdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:30:59.737316 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.737213    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:30:59.737316 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.737256    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2594bccb-5cae-4ce5-8747-cd5314ef1b63" (UID: "2594bccb-5cae-4ce5-8747-cd5314ef1b63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:30:59.836710 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.836679    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwdl\" (UniqueName: \"kubernetes.io/projected/2594bccb-5cae-4ce5-8747-cd5314ef1b63-kube-api-access-9rwdl\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.836710 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.836709    2589 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.836935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.836718    2589 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2594bccb-5cae-4ce5-8747-cd5314ef1b63-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.836935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.836729    2589 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:30:59.836935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:30:59.836737    2589 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2594bccb-5cae-4ce5-8747-cd5314ef1b63-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:00.652191 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:00.652159    2589 generic.go:356] "Generic (PLEG): container finished" podID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerID="168809912b9f2bac5d84904b06a186c6fd954e093efb5d66278e769c2b19939e" exitCode=0
Jul 06 22:31:00.652558 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:00.652245    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerDied","Data":"168809912b9f2bac5d84904b06a186c6fd954e093efb5d66278e769c2b19939e"}
Jul 06 22:31:00.652558 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:00.652294    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f64ddcb-nvwr2"
Jul 06 22:31:00.692293 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:00.692263    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:31:00.695422 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:00.695401    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9f64ddcb-nvwr2"]
Jul 06 22:31:01.783510 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.783488    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:31:01.851641 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.851610    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle\") pod \"5df925ae-b984-451b-9189-94f13b3ddf6a\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") "
Jul 06 22:31:01.851641 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.851649    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util\") pod \"5df925ae-b984-451b-9189-94f13b3ddf6a\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") "
Jul 06 22:31:01.851802 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.851675    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97bvb\" (UniqueName: \"kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb\") pod \"5df925ae-b984-451b-9189-94f13b3ddf6a\" (UID: \"5df925ae-b984-451b-9189-94f13b3ddf6a\") "
Jul 06 22:31:01.852453 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.852420    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle" (OuterVolumeSpecName: "bundle") pod "5df925ae-b984-451b-9189-94f13b3ddf6a" (UID: "5df925ae-b984-451b-9189-94f13b3ddf6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:01.853798 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.853769    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb" (OuterVolumeSpecName: "kube-api-access-97bvb") pod "5df925ae-b984-451b-9189-94f13b3ddf6a" (UID: "5df925ae-b984-451b-9189-94f13b3ddf6a"). InnerVolumeSpecName "kube-api-access-97bvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:31:01.857014 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.856994    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util" (OuterVolumeSpecName: "util") pod "5df925ae-b984-451b-9189-94f13b3ddf6a" (UID: "5df925ae-b984-451b-9189-94f13b3ddf6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:01.952544 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.952457    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:01.952544 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.952488    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df925ae-b984-451b-9189-94f13b3ddf6a-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:01.952544 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:01.952497    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97bvb\" (UniqueName: \"kubernetes.io/projected/5df925ae-b984-451b-9189-94f13b3ddf6a-kube-api-access-97bvb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:02.661293 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:02.661255    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt" event={"ID":"5df925ae-b984-451b-9189-94f13b3ddf6a","Type":"ContainerDied","Data":"64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29"}
Jul 06 22:31:02.661452 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:02.661309    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64468b1da1c6a70a527b0832e6cb649bfa0fdc405c03f2be937bdcac3dcf8a29"
Jul 06 22:31:02.661452 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:02.661275    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vrwlt"
Jul 06 22:31:02.686421 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:02.686395    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" path="/var/lib/kubelet/pods/2594bccb-5cae-4ce5-8747-cd5314ef1b63/volumes"
Jul 06 22:31:05.786828 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.786784    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"]
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787028    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" containerName="console"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787038    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" containerName="console"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787046    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="extract"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787051    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="extract"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787065    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="util"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787070    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="util"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787080    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="pull"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787085    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="pull"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787125    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="2594bccb-5cae-4ce5-8747-cd5314ef1b63" containerName="console"
Jul 06 22:31:05.787273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.787134    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df925ae-b984-451b-9189-94f13b3ddf6a" containerName="extract"
Jul 06 22:31:05.791774 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.791759    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.794501 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.794473    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 22:31:05.794878 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.794647    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:31:05.794878 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.794771    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-st6dk\""
Jul 06 22:31:05.800177 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.800152    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"]
Jul 06 22:31:05.879224 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.879183    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418e445a-2232-42c3-9b72-5184afcb2ffb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.879409 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.879249    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdtq\" (UniqueName: \"kubernetes.io/projected/418e445a-2232-42c3-9b72-5184afcb2ffb-kube-api-access-cmdtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.980542 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.980504    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdtq\" (UniqueName: \"kubernetes.io/projected/418e445a-2232-42c3-9b72-5184afcb2ffb-kube-api-access-cmdtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.980717 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.980577    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418e445a-2232-42c3-9b72-5184afcb2ffb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.980963 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.980941    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418e445a-2232-42c3-9b72-5184afcb2ffb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:05.988853 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:05.988825    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdtq\" (UniqueName: \"kubernetes.io/projected/418e445a-2232-42c3-9b72-5184afcb2ffb-kube-api-access-cmdtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-v9z4l\" (UID: \"418e445a-2232-42c3-9b72-5184afcb2ffb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:06.106617 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:06.106532    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"
Jul 06 22:31:06.232821 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:06.232777    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l"]
Jul 06 22:31:06.236143 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:31:06.236120    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418e445a_2232_42c3_9b72_5184afcb2ffb.slice/crio-4fbfad80915fc8c1e2f02232f68952dde9a5d4ce74fec91aa0cc3bdb6e5aaf84 WatchSource:0}: Error finding container 4fbfad80915fc8c1e2f02232f68952dde9a5d4ce74fec91aa0cc3bdb6e5aaf84: Status 404 returned error can't find the container with id 4fbfad80915fc8c1e2f02232f68952dde9a5d4ce74fec91aa0cc3bdb6e5aaf84
Jul 06 22:31:06.678281 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:06.678015    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l" event={"ID":"418e445a-2232-42c3-9b72-5184afcb2ffb","Type":"ContainerStarted","Data":"4fbfad80915fc8c1e2f02232f68952dde9a5d4ce74fec91aa0cc3bdb6e5aaf84"}
Jul 06 22:31:08.690086 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:08.690047    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l" event={"ID":"418e445a-2232-42c3-9b72-5184afcb2ffb","Type":"ContainerStarted","Data":"0a5ba70c926b7da19b7a81d5476147d9741eb9d6fb4a55abe2fa343a3b3f3f83"}
Jul 06 22:31:08.713237 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:08.713175    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v9z4l" podStartSLOduration=1.9829577760000001 podStartE2EDuration="3.713154245s" totalImagesPullingTime="1.730196469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:08.711920659 +0000 UTC m=+250.519667725" watchObservedRunningTime="2026-07-06 22:31:08.713154245 +0000 UTC m=+250.520901312"
Jul 06 22:31:10.420051 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.420013    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"]
Jul 06 22:31:10.423636 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.423614    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.426225 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.426203    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 22:31:10.426328 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.426203    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 22:31:10.427259 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.427240    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnnw4\""
Jul 06 22:31:10.431261 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.431242    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"]
Jul 06 22:31:10.516510 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.516472    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznzz\" (UniqueName: \"kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.516510 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.516510    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.516720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.516534    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.617626 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.617587    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznzz\" (UniqueName: \"kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.617626 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.617625    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.617847 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.617649    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.618060 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.618039    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.618060 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.618052    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.625434 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.625413    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznzz\" (UniqueName: \"kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.733013 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.732913    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:10.865142 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:10.865117    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"]
Jul 06 22:31:10.867518 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:31:10.867481    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ebaba8_39e0_4675_9016_c368af99d5f5.slice/crio-58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9 WatchSource:0}: Error finding container 58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9: Status 404 returned error can't find the container with id 58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9
Jul 06 22:31:11.702155 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:11.702120    2589 generic.go:356] "Generic (PLEG): container finished" podID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerID="d8daadbd34c05368360d477851e925a4d042b6ec6840a1bb4c8a2eebecd824e9" exitCode=0
Jul 06 22:31:11.702591 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:11.702163    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb" event={"ID":"d8ebaba8-39e0-4675-9016-c368af99d5f5","Type":"ContainerDied","Data":"d8daadbd34c05368360d477851e925a4d042b6ec6840a1bb4c8a2eebecd824e9"}
Jul 06 22:31:11.702591 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:11.702197    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb" event={"ID":"d8ebaba8-39e0-4675-9016-c368af99d5f5","Type":"ContainerStarted","Data":"58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9"}
Jul 06 22:31:14.718687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:14.718651    2589 generic.go:356] "Generic (PLEG): container finished" podID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerID="c7a9ce79d81644a30c92874b17d0c3e02a476f77ac4f851274cb739b43ee6a2f" exitCode=0
Jul 06 22:31:14.719081 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:14.718748    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb" event={"ID":"d8ebaba8-39e0-4675-9016-c368af99d5f5","Type":"ContainerDied","Data":"c7a9ce79d81644a30c92874b17d0c3e02a476f77ac4f851274cb739b43ee6a2f"}
Jul 06 22:31:15.724775 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:15.724737    2589 generic.go:356] "Generic (PLEG): container finished" podID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerID="b48d78ccaf3eb7d553d3ef49754d2f5c5b1f5d0849235a7d78de148cede10044" exitCode=0
Jul 06 22:31:15.725232 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:15.724840    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb" event={"ID":"d8ebaba8-39e0-4675-9016-c368af99d5f5","Type":"ContainerDied","Data":"b48d78ccaf3eb7d553d3ef49754d2f5c5b1f5d0849235a7d78de148cede10044"}
Jul 06 22:31:16.853695 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.853671    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:16.967624 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.967587    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util\") pod \"d8ebaba8-39e0-4675-9016-c368af99d5f5\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") "
Jul 06 22:31:16.967837 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.967634    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle\") pod \"d8ebaba8-39e0-4675-9016-c368af99d5f5\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") "
Jul 06 22:31:16.967837 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.967695    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fznzz\" (UniqueName: \"kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz\") pod \"d8ebaba8-39e0-4675-9016-c368af99d5f5\" (UID: \"d8ebaba8-39e0-4675-9016-c368af99d5f5\") "
Jul 06 22:31:16.968071 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.968046    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle" (OuterVolumeSpecName: "bundle") pod "d8ebaba8-39e0-4675-9016-c368af99d5f5" (UID: "d8ebaba8-39e0-4675-9016-c368af99d5f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:16.969820 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.969786    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz" (OuterVolumeSpecName: "kube-api-access-fznzz") pod "d8ebaba8-39e0-4675-9016-c368af99d5f5" (UID: "d8ebaba8-39e0-4675-9016-c368af99d5f5"). InnerVolumeSpecName "kube-api-access-fznzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:31:16.972304 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:16.972280    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util" (OuterVolumeSpecName: "util") pod "d8ebaba8-39e0-4675-9016-c368af99d5f5" (UID: "d8ebaba8-39e0-4675-9016-c368af99d5f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:17.068473 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.068437    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:17.068473 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.068471    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fznzz\" (UniqueName: \"kubernetes.io/projected/d8ebaba8-39e0-4675-9016-c368af99d5f5-kube-api-access-fznzz\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:17.068665 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.068486    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ebaba8-39e0-4675-9016-c368af99d5f5-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:17.735156 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.735119    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb" event={"ID":"d8ebaba8-39e0-4675-9016-c368af99d5f5","Type":"ContainerDied","Data":"58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9"}
Jul 06 22:31:17.735327 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.735173    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58d0ffd2fcb5e29228c5e1ce717b077f0bc0e5207c35b991255a893e323298b9"
Jul 06 22:31:17.735327 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:17.735133    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4wzb"
Jul 06 22:31:27.640234 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640149    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"]
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640469    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="util"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640482    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="util"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640490    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="pull"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640496    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="pull"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640511    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="extract"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640517    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="extract"
Jul 06 22:31:27.640602 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.640561    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ebaba8-39e0-4675-9016-c368af99d5f5" containerName="extract"
Jul 06 22:31:27.643341 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.643324    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.646069 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.646049    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 22:31:27.646163 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.646121    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 22:31:27.647099 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.647085    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xc2mj\""
Jul 06 22:31:27.651486 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.651461    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"]
Jul 06 22:31:27.753134 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.753099    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445qg\" (UniqueName: \"kubernetes.io/projected/2ee6683f-da92-42a5-a1db-68758384181d-kube-api-access-445qg\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.753313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.753158    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee6683f-da92-42a5-a1db-68758384181d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.854428 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.854394    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445qg\" (UniqueName: \"kubernetes.io/projected/2ee6683f-da92-42a5-a1db-68758384181d-kube-api-access-445qg\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.854595 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.854446    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee6683f-da92-42a5-a1db-68758384181d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.854762 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.854745    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee6683f-da92-42a5-a1db-68758384181d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.862617 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.862593    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-445qg\" (UniqueName: \"kubernetes.io/projected/2ee6683f-da92-42a5-a1db-68758384181d-kube-api-access-445qg\") pod \"openshift-lws-operator-fd8ccff4c-zscrr\" (UID: \"2ee6683f-da92-42a5-a1db-68758384181d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:27.952767 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:27.952676    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"
Jul 06 22:31:28.080359 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:28.080332    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr"]
Jul 06 22:31:28.083231 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:31:28.083200    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ee6683f_da92_42a5_a1db_68758384181d.slice/crio-1f3ca46cee9910fcd8a013fb9d98ceb065595ab9f1766584a6ff42988358b522 WatchSource:0}: Error finding container 1f3ca46cee9910fcd8a013fb9d98ceb065595ab9f1766584a6ff42988358b522: Status 404 returned error can't find the container with id 1f3ca46cee9910fcd8a013fb9d98ceb065595ab9f1766584a6ff42988358b522
Jul 06 22:31:28.778539 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:28.778492    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr" event={"ID":"2ee6683f-da92-42a5-a1db-68758384181d","Type":"ContainerStarted","Data":"1f3ca46cee9910fcd8a013fb9d98ceb065595ab9f1766584a6ff42988358b522"}
Jul 06 22:31:30.788274 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:30.788238    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr" event={"ID":"2ee6683f-da92-42a5-a1db-68758384181d","Type":"ContainerStarted","Data":"7d3d76ba24bb16dd9058cefcca09b6db1bba3a5878b893388ac2dcacada78154"}
Jul 06 22:31:30.810745 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:30.810697    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zscrr" podStartSLOduration=2.135202867 podStartE2EDuration="3.810681886s" totalImagesPullingTime="1.675479019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:30.809663885 +0000 UTC m=+272.617410950" watchObservedRunningTime="2026-07-06 22:31:30.810681886 +0000 UTC m=+272.618428952"
Jul 06 22:31:34.763273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.763234    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"]
Jul 06 22:31:34.766389 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.766362    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:34.769429 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.769405    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 22:31:34.769429 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.769425    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnnw4\""
Jul 06 22:31:34.770329 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.770310    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 22:31:34.775462 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.775433    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"]
Jul 06 22:31:34.915600 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.915567    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:34.915600 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.915605    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:34.915825 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:34.915634    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mtbx\" (UniqueName: \"kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.017087 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.017002    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.017087 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.017047    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.017270 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.017091    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mtbx\" (UniqueName: \"kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.017503 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.017482    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.017557 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.017540    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.025912 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.025887    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mtbx\" (UniqueName: \"kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.074963 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.074923    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:35.204728 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.204704    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"]
Jul 06 22:31:35.207150 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:31:35.207119    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17a60d5_cbfb_47b9_a2ae_28d3073d5384.slice/crio-b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a WatchSource:0}: Error finding container b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a: Status 404 returned error can't find the container with id b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a
Jul 06 22:31:35.810265 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.810234    2589 generic.go:356] "Generic (PLEG): container finished" podID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerID="73d67f10ad90efcb36db475ee01db0510c4bf6ebed0701ea2179efee3cc98a8d" exitCode=0
Jul 06 22:31:35.810710 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.810325    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx" event={"ID":"c17a60d5-cbfb-47b9-a2ae-28d3073d5384","Type":"ContainerDied","Data":"73d67f10ad90efcb36db475ee01db0510c4bf6ebed0701ea2179efee3cc98a8d"}
Jul 06 22:31:35.810710 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:35.810377    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx" event={"ID":"c17a60d5-cbfb-47b9-a2ae-28d3073d5384","Type":"ContainerStarted","Data":"b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a"}
Jul 06 22:31:36.815757 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:36.815715    2589 generic.go:356] "Generic (PLEG): container finished" podID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerID="ed02f84233dcea14e6900d24100a22f1176651d79f1243d34e04495a39c3c3e5" exitCode=0
Jul 06 22:31:36.816270 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:36.815782    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx" event={"ID":"c17a60d5-cbfb-47b9-a2ae-28d3073d5384","Type":"ContainerDied","Data":"ed02f84233dcea14e6900d24100a22f1176651d79f1243d34e04495a39c3c3e5"}
Jul 06 22:31:37.822279 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:37.822244    2589 generic.go:356] "Generic (PLEG): container finished" podID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerID="ff5603560e32c97f12d2ccb246dd22266520a328d494fe08e97c2290c213e4e1" exitCode=0
Jul 06 22:31:37.822690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:37.822346    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx" event={"ID":"c17a60d5-cbfb-47b9-a2ae-28d3073d5384","Type":"ContainerDied","Data":"ff5603560e32c97f12d2ccb246dd22266520a328d494fe08e97c2290c213e4e1"}
Jul 06 22:31:38.950394 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:38.950368    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:39.049939 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.049899    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util\") pod \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") "
Jul 06 22:31:39.050107 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.049949    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mtbx\" (UniqueName: \"kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx\") pod \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") "
Jul 06 22:31:39.050107 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.049974    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle\") pod \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\" (UID: \"c17a60d5-cbfb-47b9-a2ae-28d3073d5384\") "
Jul 06 22:31:39.050695 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.050655    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle" (OuterVolumeSpecName: "bundle") pod "c17a60d5-cbfb-47b9-a2ae-28d3073d5384" (UID: "c17a60d5-cbfb-47b9-a2ae-28d3073d5384"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:39.052082 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.052060    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx" (OuterVolumeSpecName: "kube-api-access-4mtbx") pod "c17a60d5-cbfb-47b9-a2ae-28d3073d5384" (UID: "c17a60d5-cbfb-47b9-a2ae-28d3073d5384"). InnerVolumeSpecName "kube-api-access-4mtbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:31:39.055687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.055662    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util" (OuterVolumeSpecName: "util") pod "c17a60d5-cbfb-47b9-a2ae-28d3073d5384" (UID: "c17a60d5-cbfb-47b9-a2ae-28d3073d5384"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:31:39.151286 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.151203    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:39.151286 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.151234    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mtbx\" (UniqueName: \"kubernetes.io/projected/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-kube-api-access-4mtbx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:39.151286 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.151244    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17a60d5-cbfb-47b9-a2ae-28d3073d5384-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:31:39.832235 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.832209    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx"
Jul 06 22:31:39.832235 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.832212    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhgxx" event={"ID":"c17a60d5-cbfb-47b9-a2ae-28d3073d5384","Type":"ContainerDied","Data":"b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a"}
Jul 06 22:31:39.832487 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:39.832254    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6934595aa940a3c9ccff99b4887985be2258248be363faa4e93387c342d147a"
Jul 06 22:31:46.425121 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425087    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"]
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425368    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="pull"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425386    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="pull"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425401    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="extract"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425408    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="extract"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425423    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="util"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425428    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="util"
Jul 06 22:31:46.425502 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.425476    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17a60d5-cbfb-47b9-a2ae-28d3073d5384" containerName="extract"
Jul 06 22:31:46.433233 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.433211    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.436006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.435890    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 22:31:46.436006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.435906    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 22:31:46.436006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.435979    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 22:31:46.436006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.436004    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 22:31:46.436219 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.436159    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wb5lr\""
Jul 06 22:31:46.447491 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.447466    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"]
Jul 06 22:31:46.606486 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.606447    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.606666 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.606492    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.606666 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.606549    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.606666 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.606623    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmqhk\" (UniqueName: \"kubernetes.io/projected/68a54b17-7520-4139-8b94-077190f1fa9c-kube-api-access-qmqhk\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.606781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.606680    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707387    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmqhk\" (UniqueName: \"kubernetes.io/projected/68a54b17-7520-4139-8b94-077190f1fa9c-kube-api-access-qmqhk\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707429    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707460    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707763 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707484    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707763 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707502    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.707905 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.707856    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.709698 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.709678    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a54b17-7520-4139-8b94-077190f1fa9c-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.710088 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.710066    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.710164 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.710067    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68a54b17-7520-4139-8b94-077190f1fa9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.720770 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.720743    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmqhk\" (UniqueName: \"kubernetes.io/projected/68a54b17-7520-4139-8b94-077190f1fa9c-kube-api-access-qmqhk\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-cqpll\" (UID: \"68a54b17-7520-4139-8b94-077190f1fa9c\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.743744 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.743715    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:46.880880 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:46.880727    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"]
Jul 06 22:31:46.883670 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:31:46.883646    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a54b17_7520_4139_8b94_077190f1fa9c.slice/crio-55d851911a56f8af73f3dbcdfbd010c0a3b5c2d21b8c0c6fd8d13bb2314d2c90 WatchSource:0}: Error finding container 55d851911a56f8af73f3dbcdfbd010c0a3b5c2d21b8c0c6fd8d13bb2314d2c90: Status 404 returned error can't find the container with id 55d851911a56f8af73f3dbcdfbd010c0a3b5c2d21b8c0c6fd8d13bb2314d2c90
Jul 06 22:31:47.867898 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:47.867858    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll" event={"ID":"68a54b17-7520-4139-8b94-077190f1fa9c","Type":"ContainerStarted","Data":"55d851911a56f8af73f3dbcdfbd010c0a3b5c2d21b8c0c6fd8d13bb2314d2c90"}
Jul 06 22:31:49.884441 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:49.884407    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll" event={"ID":"68a54b17-7520-4139-8b94-077190f1fa9c","Type":"ContainerStarted","Data":"5cbf24283fd0ccd307c23cf2c43c8280f7d267c8dbc54de694768cbee0f08088"}
Jul 06 22:31:51.896722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:51.896685    2589 generic.go:356] "Generic (PLEG): container finished" podID="68a54b17-7520-4139-8b94-077190f1fa9c" containerID="5cbf24283fd0ccd307c23cf2c43c8280f7d267c8dbc54de694768cbee0f08088" exitCode=0
Jul 06 22:31:51.897168 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:51.896759    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll" event={"ID":"68a54b17-7520-4139-8b94-077190f1fa9c","Type":"ContainerDied","Data":"5cbf24283fd0ccd307c23cf2c43c8280f7d267c8dbc54de694768cbee0f08088"}
Jul 06 22:31:52.902753 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:52.902716    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll" event={"ID":"68a54b17-7520-4139-8b94-077190f1fa9c","Type":"ContainerStarted","Data":"2cf598b2ce5486ccfca54216350088bcff9ae6d52c6f27fcf498bcfbd1bf44ac"}
Jul 06 22:31:52.903174 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:52.902954    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:31:52.924666 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:52.924601    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll" podStartSLOduration=2.598628836 podStartE2EDuration="6.924586814s" totalImagesPullingTime="3.239400898s" totalInitContainerRuntime="1.08655708s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:52.923239298 +0000 UTC m=+294.730986377" watchObservedRunningTime="2026-07-06 22:31:52.924586814 +0000 UTC m=+294.732333880"
Jul 06 22:31:58.629769 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:58.629735    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:31:58.633787 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:58.633763    2589 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 22:31:58.642272 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:31:58.642247    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:32:03.910287 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:03.910255    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-cqpll"
Jul 06 22:32:05.901533 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.901497    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"]
Jul 06 22:32:05.905766 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.905744    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:05.908402 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.908379    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 22:32:05.908402 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.908400    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 22:32:05.908562 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.908476    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-crx5m\""
Jul 06 22:32:05.915316 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.915295    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"]
Jul 06 22:32:05.965325 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.965289    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:05.965511 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.965345    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tmp\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:05.965511 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:05.965370    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnsj\" (UniqueName: \"kubernetes.io/projected/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-kube-api-access-lmnsj\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.066522 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.066485    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.066719 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.066537    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tmp\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.066719 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:32:06.066641    2589 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 22:32:06.066719 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.066661    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnsj\" (UniqueName: \"kubernetes.io/projected/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-kube-api-access-lmnsj\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.066719 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:32:06.066719    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs podName:3ad3652d-bb0a-4252-a75c-c6bb1f8af914 nodeName:}" failed. No retries permitted until 2026-07-06 22:32:06.5666974 +0000 UTC m=+308.374444457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs") pod "kube-auth-proxy-5cfdb4967c-4sbrl" (UID: "3ad3652d-bb0a-4252-a75c-c6bb1f8af914") : secret "kube-auth-proxy-tls" not found
Jul 06 22:32:06.068909 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.068884    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tmp\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.082296 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.082264    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x74lk"]
Jul 06 22:32:06.084680 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.084659    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnsj\" (UniqueName: \"kubernetes.io/projected/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-kube-api-access-lmnsj\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.086467 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.086449    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.088768 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.088748    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 22:32:06.088881 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.088757    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wqjpj\""
Jul 06 22:32:06.097873 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.097853    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x74lk"]
Jul 06 22:32:06.167866 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.167752    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.167866 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.167800    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nglf\" (UniqueName: \"kubernetes.io/projected/5cfe4904-6e09-42cf-9db2-148973907030-kube-api-access-5nglf\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.268672 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.268634    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.268880 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.268686    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nglf\" (UniqueName: \"kubernetes.io/projected/5cfe4904-6e09-42cf-9db2-148973907030-kube-api-access-5nglf\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.268880 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:32:06.268772    2589 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 22:32:06.268880 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:32:06.268858    2589 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert podName:5cfe4904-6e09-42cf-9db2-148973907030 nodeName:}" failed. No retries permitted until 2026-07-06 22:32:06.768837972 +0000 UTC m=+308.576585037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert") pod "odh-model-controller-7998c67dc4-x74lk" (UID: "5cfe4904-6e09-42cf-9db2-148973907030") : secret "odh-model-controller-webhook-cert" not found
Jul 06 22:32:06.281074 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.281047    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nglf\" (UniqueName: \"kubernetes.io/projected/5cfe4904-6e09-42cf-9db2-148973907030-kube-api-access-5nglf\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.571360 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.571322    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.573673 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.573646    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ad3652d-bb0a-4252-a75c-c6bb1f8af914-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-4sbrl\" (UID: \"3ad3652d-bb0a-4252-a75c-c6bb1f8af914\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.773520 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.773476    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.775897 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.775870    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfe4904-6e09-42cf-9db2-148973907030-cert\") pod \"odh-model-controller-7998c67dc4-x74lk\" (UID: \"5cfe4904-6e09-42cf-9db2-148973907030\") " pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:06.815789 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.815759    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"
Jul 06 22:32:06.944065 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.943927    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl"]
Jul 06 22:32:06.946767 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:32:06.946729    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad3652d_bb0a_4252_a75c_c6bb1f8af914.slice/crio-de72001cfe9a1cd465b640a52cf3b50012b6db1435fc3b098f0837a49e9036f7 WatchSource:0}: Error finding container de72001cfe9a1cd465b640a52cf3b50012b6db1435fc3b098f0837a49e9036f7: Status 404 returned error can't find the container with id de72001cfe9a1cd465b640a52cf3b50012b6db1435fc3b098f0837a49e9036f7
Jul 06 22:32:06.948559 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.948544    2589 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:32:06.968855 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:06.968828    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl" event={"ID":"3ad3652d-bb0a-4252-a75c-c6bb1f8af914","Type":"ContainerStarted","Data":"de72001cfe9a1cd465b640a52cf3b50012b6db1435fc3b098f0837a49e9036f7"}
Jul 06 22:32:07.000948 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.000921    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:07.117305 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.117275    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:07.122273 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.122249    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.124646 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.124619    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 22:32:07.124775 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.124696    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 22:32:07.124775 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.124717    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 22:32:07.124775 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.124732    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8d2mp\""
Jul 06 22:32:07.124932 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.124855    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 22:32:07.133004 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.132981    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:07.144477 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.144458    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x74lk"]
Jul 06 22:32:07.147578 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:32:07.147557    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfe4904_6e09_42cf_9db2_148973907030.slice/crio-bd4e66274f285254acf8bad502967509c58a6e3dee622861c0fb0c5aa343d757 WatchSource:0}: Error finding container bd4e66274f285254acf8bad502967509c58a6e3dee622861c0fb0c5aa343d757: Status 404 returned error can't find the container with id bd4e66274f285254acf8bad502967509c58a6e3dee622861c0fb0c5aa343d757
Jul 06 22:32:07.177916 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.177887    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tss7\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178035 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.177939    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178035 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.177987    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178035 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.178022    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178148 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.178073    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178148 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.178096    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.178148 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.178113    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279043 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279007    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279043 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279046    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279074    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279123    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279150    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279177    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.279290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279215    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tss7\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.280045 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.279842    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.281832 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.281785    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.282024 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.282000    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.282106 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.282049    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.282106 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.282084    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.288684 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.288661    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.288786 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.288726    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tss7\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7\") pod \"istiod-openshift-gateway-7574459656-4n9kb\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.432196 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.432108    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:07.575414 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.575383    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:07.577141 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:32:07.577113    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030a2602_3adc_4364_ab02_6418acbf37e5.slice/crio-2b307ec224e5fbb9319b989bc6b18ae46e9a8cf907429f47c0c1e2c76d7bb45c WatchSource:0}: Error finding container 2b307ec224e5fbb9319b989bc6b18ae46e9a8cf907429f47c0c1e2c76d7bb45c: Status 404 returned error can't find the container with id 2b307ec224e5fbb9319b989bc6b18ae46e9a8cf907429f47c0c1e2c76d7bb45c
Jul 06 22:32:07.976192 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.976150    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" event={"ID":"030a2602-3adc-4364-ab02-6418acbf37e5","Type":"ContainerStarted","Data":"2b307ec224e5fbb9319b989bc6b18ae46e9a8cf907429f47c0c1e2c76d7bb45c"}
Jul 06 22:32:07.977601 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:07.977570    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk" event={"ID":"5cfe4904-6e09-42cf-9db2-148973907030","Type":"ContainerStarted","Data":"bd4e66274f285254acf8bad502967509c58a6e3dee622861c0fb0c5aa343d757"}
Jul 06 22:32:12.072156 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:12.072113    2589 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 22:32:12.072435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:12.072201    2589 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 22:32:13.005730 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.005690    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl" event={"ID":"3ad3652d-bb0a-4252-a75c-c6bb1f8af914","Type":"ContainerStarted","Data":"f30920e17b371f0f4597b0af51c54e8365339351034a456a28419101307acba3"}
Jul 06 22:32:13.007149 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.007123    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" event={"ID":"030a2602-3adc-4364-ab02-6418acbf37e5","Type":"ContainerStarted","Data":"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"}
Jul 06 22:32:13.007297 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.007278    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:13.008687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.008657    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk" event={"ID":"5cfe4904-6e09-42cf-9db2-148973907030","Type":"ContainerStarted","Data":"38ddd98211f557049be3e24558ee9e2346a876c658dc8295e38e2a7c3bc12769"}
Jul 06 22:32:13.008844 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.008796    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:13.009198 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.009181    2589 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4n9kb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 22:32:13.009245 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.009224    2589 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 22:32:13.025701 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.025658    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-4sbrl" podStartSLOduration=2.907955694 podStartE2EDuration="8.025645799s" totalImagesPullingTime="5.117690105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:13.024288513 +0000 UTC m=+314.832035581" watchObservedRunningTime="2026-07-06 22:32:13.025645799 +0000 UTC m=+314.833392865"
Jul 06 22:32:13.047359 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.047312    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk" podStartSLOduration=2.12368165 podStartE2EDuration="7.047297943s" totalImagesPullingTime="4.923616293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:13.045134932 +0000 UTC m=+314.852881999" watchObservedRunningTime="2026-07-06 22:32:13.047297943 +0000 UTC m=+314.855045008"
Jul 06 22:32:13.066284 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:13.066238    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" podStartSLOduration=1.57403864 podStartE2EDuration="6.066222421s" totalImagesPullingTime="4.492183781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:13.064621044 +0000 UTC m=+314.872368112" watchObservedRunningTime="2026-07-06 22:32:13.066222421 +0000 UTC m=+314.873969487"
Jul 06 22:32:14.014030 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:14.013998    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:16.218636 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.218602    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"]
Jul 06 22:32:16.221999 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.221983    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.226159 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.226135    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l98fd\""
Jul 06 22:32:16.226159 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.226153    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 22:32:16.226315 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.226181    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 22:32:16.226315 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.226213    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 22:32:16.231978 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.231957    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"]
Jul 06 22:32:16.257297 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.257269    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-manager-config\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.257432 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.257305    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x7mf\" (UniqueName: \"kubernetes.io/projected/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-kube-api-access-4x7mf\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.257432 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.257340    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.257432 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.257391    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-metrics-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.358587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.358547    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-manager-config\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.358587 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.358590    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x7mf\" (UniqueName: \"kubernetes.io/projected/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-kube-api-access-4x7mf\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.358799 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.358623    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.358799 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.358657    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-metrics-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.359243 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.359215    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-manager-config\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.361112 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.361084    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-metrics-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.361227 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.361120    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-cert\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.369528 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.369500    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x7mf\" (UniqueName: \"kubernetes.io/projected/5d0af2d4-a0b3-4e2c-9366-01cf23935c1d-kube-api-access-4x7mf\") pod \"lws-controller-manager-c7f89b564-kln9r\" (UID: \"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d\") " pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.531975 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.531946    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:16.687725 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:16.687694    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"]
Jul 06 22:32:16.688095 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:32:16.688071    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0af2d4_a0b3_4e2c_9366_01cf23935c1d.slice/crio-3c07d31861d9ddec740ab21c24343b6103fb0bb1ed74f0b737ba31345561d456 WatchSource:0}: Error finding container 3c07d31861d9ddec740ab21c24343b6103fb0bb1ed74f0b737ba31345561d456: Status 404 returned error can't find the container with id 3c07d31861d9ddec740ab21c24343b6103fb0bb1ed74f0b737ba31345561d456
Jul 06 22:32:17.029016 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:17.028981    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r" event={"ID":"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d","Type":"ContainerStarted","Data":"3c07d31861d9ddec740ab21c24343b6103fb0bb1ed74f0b737ba31345561d456"}
Jul 06 22:32:19.039916 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.039878    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r" event={"ID":"5d0af2d4-a0b3-4e2c-9366-01cf23935c1d","Type":"ContainerStarted","Data":"6391f6137b2f3886fcc2f7e5e5d3afe2494b7a423f18fcb07a65443b4039fddf"}
Jul 06 22:32:19.040336 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.039955    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:32:19.069308 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.069263    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r" podStartSLOduration=1.055252188 podStartE2EDuration="3.069246789s" totalImagesPullingTime="2.013994601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:19.068242531 +0000 UTC m=+320.875989598" watchObservedRunningTime="2026-07-06 22:32:19.069246789 +0000 UTC m=+320.876993855"
Jul 06 22:32:19.372771 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.372686    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:19.372961 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.372881    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" containerName="discovery" containerID="cri-o://50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50" gracePeriod=30
Jul 06 22:32:19.606042 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.606015    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:19.688613 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688509    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688613 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688580    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688613 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688612    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688641    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688692    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688717    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.688940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.688757    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tss7\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7\") pod \"030a2602-3adc-4364-ab02-6418acbf37e5\" (UID: \"030a2602-3adc-4364-ab02-6418acbf37e5\") "
Jul 06 22:32:19.689148 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.689121    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:32:19.691006 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.690974    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts" (OuterVolumeSpecName: "cacerts") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:32:19.691120 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.691018    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:32:19.691269 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.691241    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:32:19.691362 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.691281    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7" (OuterVolumeSpecName: "kube-api-access-5tss7") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "kube-api-access-5tss7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:32:19.691362 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.691284    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:32:19.691362 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.691295    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs" (OuterVolumeSpecName: "local-certs") pod "030a2602-3adc-4364-ab02-6418acbf37e5" (UID: "030a2602-3adc-4364-ab02-6418acbf37e5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:32:19.789526 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789491    2589 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789526 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789518    2589 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/030a2602-3adc-4364-ab02-6418acbf37e5-local-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789526 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789529    2589 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-ca-configmap\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789742 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789539    2589 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-kubeconfig\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789742 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789548    2589 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-istio-csr-dns-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789742 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789556    2589 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/030a2602-3adc-4364-ab02-6418acbf37e5-cacerts\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:19.789742 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:19.789564    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tss7\" (UniqueName: \"kubernetes.io/projected/030a2602-3adc-4364-ab02-6418acbf37e5-kube-api-access-5tss7\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:32:20.046088 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.046057    2589 generic.go:356] "Generic (PLEG): container finished" podID="030a2602-3adc-4364-ab02-6418acbf37e5" containerID="50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50" exitCode=0
Jul 06 22:32:20.046524 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.046105    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"
Jul 06 22:32:20.046524 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.046144    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" event={"ID":"030a2602-3adc-4364-ab02-6418acbf37e5","Type":"ContainerDied","Data":"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"}
Jul 06 22:32:20.046524 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.046195    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb" event={"ID":"030a2602-3adc-4364-ab02-6418acbf37e5","Type":"ContainerDied","Data":"2b307ec224e5fbb9319b989bc6b18ae46e9a8cf907429f47c0c1e2c76d7bb45c"}
Jul 06 22:32:20.046524 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.046222    2589 scope.go:117] "RemoveContainer" containerID="50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"
Jul 06 22:32:20.054862 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.054844    2589 scope.go:117] "RemoveContainer" containerID="50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"
Jul 06 22:32:20.055112 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:32:20.055092    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50\": container with ID starting with 50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50 not found: ID does not exist" containerID="50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"
Jul 06 22:32:20.055147 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.055122    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50"} err="failed to get container status \"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50\": rpc error: code = NotFound desc = could not find container \"50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50\": container with ID starting with 50428ad0ade734e3c9223b8d6dd3e4f6d9b016ffa0feac1d40aa8c86025d2d50 not found: ID does not exist"
Jul 06 22:32:20.067727 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.067705    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:20.081290 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.081270    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n9kb"]
Jul 06 22:32:20.691321 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:20.691274    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" path="/var/lib/kubelet/pods/030a2602-3adc-4364-ab02-6418acbf37e5/volumes"
Jul 06 22:32:24.025281 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:24.025242    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-x74lk"
Jul 06 22:32:30.048820 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:32:30.048777    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c7f89b564-kln9r"
Jul 06 22:33:22.500101 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.500065    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"]
Jul 06 22:33:22.500535 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.500351    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" containerName="discovery"
Jul 06 22:33:22.500535 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.500363    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" containerName="discovery"
Jul 06 22:33:22.500535 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.500441    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="030a2602-3adc-4364-ab02-6418acbf37e5" containerName="discovery"
Jul 06 22:33:22.503218 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.503200    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.505929 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.505909    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pn84x\""
Jul 06 22:33:22.506065 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.505911    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 22:33:22.506876 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.506854    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 22:33:22.511858 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.511837    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"]
Jul 06 22:33:22.596818 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.596784    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.596981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.596836    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.596981 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.596870    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdng\" (UniqueName: \"kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.698074 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.698044    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.698236 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.698082    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.698236 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.698118    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdng\" (UniqueName: \"kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.698408 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.698390    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.698479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.698461    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.706390 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.706362    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdng\" (UniqueName: \"kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.812516 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.812470    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:22.940993 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:22.940900    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"]
Jul 06 22:33:22.943708 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:33:22.943671    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a398a4_3033_46c9_856b_a5f2155c8949.slice/crio-ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f WatchSource:0}: Error finding container ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f: Status 404 returned error can't find the container with id ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f
Jul 06 22:33:23.100221 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.100154    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"]
Jul 06 22:33:23.103620 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.103600    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.112176 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.112149    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"]
Jul 06 22:33:23.202582 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.202539    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwsr8\" (UniqueName: \"kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.202758 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.202588    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.202758 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.202702    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.303358 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.303321    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwsr8\" (UniqueName: \"kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.303358 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.303361    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.303594 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.303392    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.303783 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.303761    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.303923 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.303795    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.312199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.312175    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwsr8\" (UniqueName: \"kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.332052 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.332023    2589 generic.go:356] "Generic (PLEG): container finished" podID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerID="bc1601f62dbea5e04874f63e313e1ffe782c230415edab069f2c042d38478cd6" exitCode=0
Jul 06 22:33:23.332158 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.332109    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg" event={"ID":"b7a398a4-3033-46c9-856b-a5f2155c8949","Type":"ContainerDied","Data":"bc1601f62dbea5e04874f63e313e1ffe782c230415edab069f2c042d38478cd6"}
Jul 06 22:33:23.332200 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.332163    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg" event={"ID":"b7a398a4-3033-46c9-856b-a5f2155c8949","Type":"ContainerStarted","Data":"ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f"}
Jul 06 22:33:23.425616 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.425520    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:23.504293 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.504256    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"]
Jul 06 22:33:23.508118 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.508100    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.516568 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.516293    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"]
Jul 06 22:33:23.561940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.561917    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"]
Jul 06 22:33:23.563714 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:33:23.563691    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2d389c_e65f_4479_966b_5a7f22a925a5.slice/crio-a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581 WatchSource:0}: Error finding container a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581: Status 404 returned error can't find the container with id a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581
Jul 06 22:33:23.605661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.605634    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n48b\" (UniqueName: \"kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.605754 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.605680    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.605754 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.605719    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.706730 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.706619    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.706730 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.706701    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.706972 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.706771    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n48b\" (UniqueName: \"kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.707090 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.707066    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.707152 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.707098    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.715960 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.715938    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n48b\" (UniqueName: \"kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.820490 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.820457    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:23.904539 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.904507    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"]
Jul 06 22:33:23.916412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.915304    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:23.922266 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.921649    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"]
Jul 06 22:33:23.967610 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:23.967586    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"]
Jul 06 22:33:24.010697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.010657    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8wb\" (UniqueName: \"kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.010876 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.010706    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.010876 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.010733    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.019607 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:33:24.019580    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bc6dcc_09d1_438a_93d0_c4473fdb619d.slice/crio-5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a WatchSource:0}: Error finding container 5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a: Status 404 returned error can't find the container with id 5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a
Jul 06 22:33:24.111301 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.111268    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8wb\" (UniqueName: \"kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.111442 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.111338    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.111442 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.111366    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.111803 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.111778    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.111948 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.111836    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.119599 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.119575    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8wb\" (UniqueName: \"kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.230328 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.230250    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:24.340255 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.340226    2589 generic.go:356] "Generic (PLEG): container finished" podID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerID="8785ce3d882556498c093824290d8fe12aa5fdcb22e74feecd95c166bcde58b4" exitCode=0
Jul 06 22:33:24.340409 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.340290    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg" event={"ID":"b7a398a4-3033-46c9-856b-a5f2155c8949","Type":"ContainerDied","Data":"8785ce3d882556498c093824290d8fe12aa5fdcb22e74feecd95c166bcde58b4"}
Jul 06 22:33:24.341907 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.341888    2589 generic.go:356] "Generic (PLEG): container finished" podID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerID="14cb471e9c7ac4a6450479fdefc3aa78ae884c900bc1c6e2f8f05a056e1e327e" exitCode=0
Jul 06 22:33:24.341983 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.341948    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc" event={"ID":"3f2d389c-e65f-4479-966b-5a7f22a925a5","Type":"ContainerDied","Data":"14cb471e9c7ac4a6450479fdefc3aa78ae884c900bc1c6e2f8f05a056e1e327e"}
Jul 06 22:33:24.342038 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.341991    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc" event={"ID":"3f2d389c-e65f-4479-966b-5a7f22a925a5","Type":"ContainerStarted","Data":"a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581"}
Jul 06 22:33:24.343862 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.343836    2589 generic.go:356] "Generic (PLEG): container finished" podID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerID="6056e21c26e38656bd12dfbc36f502df1d737785cbbf7259c4274f3e86023fff" exitCode=0
Jul 06 22:33:24.343962 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.343883    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j" event={"ID":"70bc6dcc-09d1-438a-93d0-c4473fdb619d","Type":"ContainerDied","Data":"6056e21c26e38656bd12dfbc36f502df1d737785cbbf7259c4274f3e86023fff"}
Jul 06 22:33:24.343962 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.343916    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j" event={"ID":"70bc6dcc-09d1-438a-93d0-c4473fdb619d","Type":"ContainerStarted","Data":"5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a"}
Jul 06 22:33:24.360591 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:24.358133    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"]
Jul 06 22:33:24.370883 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:33:24.370861    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cef8cf_9df8_4d66_81ab_508b993d5622.slice/crio-faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93 WatchSource:0}: Error finding container faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93: Status 404 returned error can't find the container with id faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93
Jul 06 22:33:25.350558 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.350522    2589 generic.go:356] "Generic (PLEG): container finished" podID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerID="1d79a01cb8f52e23580812e751e7f8180677c6df085730ddd11f33743ad4696a" exitCode=0
Jul 06 22:33:25.351008 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.350612    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h" event={"ID":"87cef8cf-9df8-4d66-81ab-508b993d5622","Type":"ContainerDied","Data":"1d79a01cb8f52e23580812e751e7f8180677c6df085730ddd11f33743ad4696a"}
Jul 06 22:33:25.351008 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.350669    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h" event={"ID":"87cef8cf-9df8-4d66-81ab-508b993d5622","Type":"ContainerStarted","Data":"faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93"}
Jul 06 22:33:25.352529 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.352508    2589 generic.go:356] "Generic (PLEG): container finished" podID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerID="012369694e35226759bfa3fa36799ccb5e8cf647307c9a51b9da75a24bf61875" exitCode=0
Jul 06 22:33:25.352643 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.352579    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j" event={"ID":"70bc6dcc-09d1-438a-93d0-c4473fdb619d","Type":"ContainerDied","Data":"012369694e35226759bfa3fa36799ccb5e8cf647307c9a51b9da75a24bf61875"}
Jul 06 22:33:25.354842 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.354820    2589 generic.go:356] "Generic (PLEG): container finished" podID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerID="8cea22ce018c1eec08bd24244b2a908a459766d67a729c4bb0f9fc1ca4533fff" exitCode=0
Jul 06 22:33:25.354934 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.354898    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg" event={"ID":"b7a398a4-3033-46c9-856b-a5f2155c8949","Type":"ContainerDied","Data":"8cea22ce018c1eec08bd24244b2a908a459766d67a729c4bb0f9fc1ca4533fff"}
Jul 06 22:33:25.356589 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.356571    2589 generic.go:356] "Generic (PLEG): container finished" podID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerID="26d33a6d923e86c8df1701a5e983099b928cacee05e7980b3273f1cda8fd36b8" exitCode=0
Jul 06 22:33:25.356589 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:25.356597    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc" event={"ID":"3f2d389c-e65f-4479-966b-5a7f22a925a5","Type":"ContainerDied","Data":"26d33a6d923e86c8df1701a5e983099b928cacee05e7980b3273f1cda8fd36b8"}
Jul 06 22:33:26.368315 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.368277    2589 generic.go:356] "Generic (PLEG): container finished" podID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerID="eaa88b15451053975bd0c597e06702e81f5c84964794a97f049e8eb03f865fe3" exitCode=0
Jul 06 22:33:26.368738 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.368376    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc" event={"ID":"3f2d389c-e65f-4479-966b-5a7f22a925a5","Type":"ContainerDied","Data":"eaa88b15451053975bd0c597e06702e81f5c84964794a97f049e8eb03f865fe3"}
Jul 06 22:33:26.370184 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.370156    2589 generic.go:356] "Generic (PLEG): container finished" podID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerID="eaa8defcdc5c23001c8f2f85d6dbae228193fc9446d5d42b5399b20d96335ff7" exitCode=0
Jul 06 22:33:26.370312 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.370199    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h" event={"ID":"87cef8cf-9df8-4d66-81ab-508b993d5622","Type":"ContainerDied","Data":"eaa8defcdc5c23001c8f2f85d6dbae228193fc9446d5d42b5399b20d96335ff7"}
Jul 06 22:33:26.372429 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.372408    2589 generic.go:356] "Generic (PLEG): container finished" podID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerID="d2a145b0372ebc545a552dc0f4c1ec56b6a2df84c8dffb2ef3188e168fd1278b" exitCode=0
Jul 06 22:33:26.372512 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.372457    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j" event={"ID":"70bc6dcc-09d1-438a-93d0-c4473fdb619d","Type":"ContainerDied","Data":"d2a145b0372ebc545a552dc0f4c1ec56b6a2df84c8dffb2ef3188e168fd1278b"}
Jul 06 22:33:26.501476 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.501452    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:26.633229 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.633144    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util\") pod \"b7a398a4-3033-46c9-856b-a5f2155c8949\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") "
Jul 06 22:33:26.633229 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.633196    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle\") pod \"b7a398a4-3033-46c9-856b-a5f2155c8949\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") "
Jul 06 22:33:26.633470 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.633252    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjdng\" (UniqueName: \"kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng\") pod \"b7a398a4-3033-46c9-856b-a5f2155c8949\" (UID: \"b7a398a4-3033-46c9-856b-a5f2155c8949\") "
Jul 06 22:33:26.633750 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.633722    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle" (OuterVolumeSpecName: "bundle") pod "b7a398a4-3033-46c9-856b-a5f2155c8949" (UID: "b7a398a4-3033-46c9-856b-a5f2155c8949"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:26.635467 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.635444    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng" (OuterVolumeSpecName: "kube-api-access-qjdng") pod "b7a398a4-3033-46c9-856b-a5f2155c8949" (UID: "b7a398a4-3033-46c9-856b-a5f2155c8949"). InnerVolumeSpecName "kube-api-access-qjdng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:33:26.638307 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.638285    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util" (OuterVolumeSpecName: "util") pod "b7a398a4-3033-46c9-856b-a5f2155c8949" (UID: "b7a398a4-3033-46c9-856b-a5f2155c8949"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:26.734177 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.734147    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjdng\" (UniqueName: \"kubernetes.io/projected/b7a398a4-3033-46c9-856b-a5f2155c8949-kube-api-access-qjdng\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:26.734177 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.734175    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:26.734327 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:26.734190    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a398a4-3033-46c9-856b-a5f2155c8949-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.378819 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.378786    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg"
Jul 06 22:33:27.379235 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.378825    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg" event={"ID":"b7a398a4-3033-46c9-856b-a5f2155c8949","Type":"ContainerDied","Data":"ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f"}
Jul 06 22:33:27.379235 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.378878    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad2e4ad69b2d4dd0b3bb109d48323d15acbdd43c4fddab1e6cfc17d67f37e00f"
Jul 06 22:33:27.381049 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.381023    2589 generic.go:356] "Generic (PLEG): container finished" podID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerID="cecb0947ead3be4c65bb64220afe17134ce514d39e0f9d5cf1c247ad4be76dd2" exitCode=0
Jul 06 22:33:27.381158 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.381092    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h" event={"ID":"87cef8cf-9df8-4d66-81ab-508b993d5622","Type":"ContainerDied","Data":"cecb0947ead3be4c65bb64220afe17134ce514d39e0f9d5cf1c247ad4be76dd2"}
Jul 06 22:33:27.530984 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.530961    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:27.532995 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.532976    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:27.642039 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.641942    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle\") pod \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") "
Jul 06 22:33:27.642039 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.641996    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util\") pod \"3f2d389c-e65f-4479-966b-5a7f22a925a5\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") "
Jul 06 22:33:27.642268 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642056    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util\") pod \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") "
Jul 06 22:33:27.642268 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642091    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwsr8\" (UniqueName: \"kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8\") pod \"3f2d389c-e65f-4479-966b-5a7f22a925a5\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") "
Jul 06 22:33:27.642268 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642136    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n48b\" (UniqueName: \"kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b\") pod \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\" (UID: \"70bc6dcc-09d1-438a-93d0-c4473fdb619d\") "
Jul 06 22:33:27.642268 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642166    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle\") pod \"3f2d389c-e65f-4479-966b-5a7f22a925a5\" (UID: \"3f2d389c-e65f-4479-966b-5a7f22a925a5\") "
Jul 06 22:33:27.642735 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642703    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle" (OuterVolumeSpecName: "bundle") pod "3f2d389c-e65f-4479-966b-5a7f22a925a5" (UID: "3f2d389c-e65f-4479-966b-5a7f22a925a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:27.642972 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.642712    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle" (OuterVolumeSpecName: "bundle") pod "70bc6dcc-09d1-438a-93d0-c4473fdb619d" (UID: "70bc6dcc-09d1-438a-93d0-c4473fdb619d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:27.644661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.644637    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8" (OuterVolumeSpecName: "kube-api-access-dwsr8") pod "3f2d389c-e65f-4479-966b-5a7f22a925a5" (UID: "3f2d389c-e65f-4479-966b-5a7f22a925a5"). InnerVolumeSpecName "kube-api-access-dwsr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:33:27.644725 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.644693    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b" (OuterVolumeSpecName: "kube-api-access-5n48b") pod "70bc6dcc-09d1-438a-93d0-c4473fdb619d" (UID: "70bc6dcc-09d1-438a-93d0-c4473fdb619d"). InnerVolumeSpecName "kube-api-access-5n48b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:33:27.648762 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.648727    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util" (OuterVolumeSpecName: "util") pod "3f2d389c-e65f-4479-966b-5a7f22a925a5" (UID: "3f2d389c-e65f-4479-966b-5a7f22a925a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:27.650052 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.650025    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util" (OuterVolumeSpecName: "util") pod "70bc6dcc-09d1-438a-93d0-c4473fdb619d" (UID: "70bc6dcc-09d1-438a-93d0-c4473fdb619d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:27.742707 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742668    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.742707 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742696    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwsr8\" (UniqueName: \"kubernetes.io/projected/3f2d389c-e65f-4479-966b-5a7f22a925a5-kube-api-access-dwsr8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.742707 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742707    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n48b\" (UniqueName: \"kubernetes.io/projected/70bc6dcc-09d1-438a-93d0-c4473fdb619d-kube-api-access-5n48b\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.742707 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742716    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.743069 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742725    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70bc6dcc-09d1-438a-93d0-c4473fdb619d-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:27.743069 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:27.742732    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2d389c-e65f-4479-966b-5a7f22a925a5-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:28.388224 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.388179    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j" event={"ID":"70bc6dcc-09d1-438a-93d0-c4473fdb619d","Type":"ContainerDied","Data":"5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a"}
Jul 06 22:33:28.388722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.388246    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a582eec39881f89083f7bb9401c25b108d1fe0ab21572e6a887a32fc8ad1f5a"
Jul 06 22:33:28.388722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.388198    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j"
Jul 06 22:33:28.390107 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.390087    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc"
Jul 06 22:33:28.390249 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.390112    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc" event={"ID":"3f2d389c-e65f-4479-966b-5a7f22a925a5","Type":"ContainerDied","Data":"a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581"}
Jul 06 22:33:28.390249 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.390151    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a352c07fb685c98ca65b3bfca00eefbd1ebbcd7669f1ae1a6013b4c7f30f4581"
Jul 06 22:33:28.524267 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.524244    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:28.650142 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.650058    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx8wb\" (UniqueName: \"kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb\") pod \"87cef8cf-9df8-4d66-81ab-508b993d5622\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") "
Jul 06 22:33:28.650293 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.650151    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util\") pod \"87cef8cf-9df8-4d66-81ab-508b993d5622\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") "
Jul 06 22:33:28.650293 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.650173    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle\") pod \"87cef8cf-9df8-4d66-81ab-508b993d5622\" (UID: \"87cef8cf-9df8-4d66-81ab-508b993d5622\") "
Jul 06 22:33:28.650690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.650664    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle" (OuterVolumeSpecName: "bundle") pod "87cef8cf-9df8-4d66-81ab-508b993d5622" (UID: "87cef8cf-9df8-4d66-81ab-508b993d5622"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:28.652254 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.652235    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb" (OuterVolumeSpecName: "kube-api-access-hx8wb") pod "87cef8cf-9df8-4d66-81ab-508b993d5622" (UID: "87cef8cf-9df8-4d66-81ab-508b993d5622"). InnerVolumeSpecName "kube-api-access-hx8wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:33:28.654886 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.654864    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util" (OuterVolumeSpecName: "util") pod "87cef8cf-9df8-4d66-81ab-508b993d5622" (UID: "87cef8cf-9df8-4d66-81ab-508b993d5622"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:33:28.751331 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.751300    2589 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:28.751331 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.751326    2589 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cef8cf-9df8-4d66-81ab-508b993d5622-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:28.751331 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:28.751335    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx8wb\" (UniqueName: \"kubernetes.io/projected/87cef8cf-9df8-4d66-81ab-508b993d5622-kube-api-access-hx8wb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:33:29.396681 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:29.396642    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h" event={"ID":"87cef8cf-9df8-4d66-81ab-508b993d5622","Type":"ContainerDied","Data":"faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93"}
Jul 06 22:33:29.396681 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:29.396688    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa7d68d314a4f1ce95b8147e244c94ce2f49c7e02e1ce38414e2262764bad93"
Jul 06 22:33:29.397217 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:29.396695    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h"
Jul 06 22:33:55.260471 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260437    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"]
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260742    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260755    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260764    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260769    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260776    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260782    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260787    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260792    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260799    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260816    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260825    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260830    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260837    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260843    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260849    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260854    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260864    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260868    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260876    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260880    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="util"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260886    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260891    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="extract"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260896    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260902    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="pull"
Jul 06 22:33:55.260943 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260951    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="70bc6dcc-09d1-438a-93d0-c4473fdb619d" containerName="extract"
Jul 06 22:33:55.261731 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260959    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f2d389c-e65f-4479-966b-5a7f22a925a5" containerName="extract"
Jul 06 22:33:55.261731 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260965    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a398a4-3033-46c9-856b-a5f2155c8949" containerName="extract"
Jul 06 22:33:55.261731 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.260971    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cef8cf-9df8-4d66-81ab-508b993d5622" containerName="extract"
Jul 06 22:33:55.265404 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.265387    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.267639 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.267619    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 22:33:55.267956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.267931    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 22:33:55.267956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.267939    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 22:33:55.267956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.267938    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 22:33:55.269417 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.269395    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pn84x\""
Jul 06 22:33:55.272095 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.272072    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"]
Jul 06 22:33:55.365174 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.365140    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64c9\" (UniqueName: \"kubernetes.io/projected/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-kube-api-access-t64c9\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.365339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.365189    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.365339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.365273    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.465929 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.465871    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.465929 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.465944    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64c9\" (UniqueName: \"kubernetes.io/projected/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-kube-api-access-t64c9\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.466149 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.465974    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.466483 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.466463    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.468372 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.468351    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.473673 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.473648    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64c9\" (UniqueName: \"kubernetes.io/projected/e3719a3d-b9d1-40fd-956b-b7a3723a0fb6-kube-api-access-t64c9\") pod \"kuadrant-console-plugin-66b5774985-vs26t\" (UID: \"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.575625 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.575598    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"
Jul 06 22:33:55.728219 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:55.728148    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t"]
Jul 06 22:33:55.730402 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:33:55.730380    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3719a3d_b9d1_40fd_956b_b7a3723a0fb6.slice/crio-2b6bd7a833bbb7e7d9ff30faacee09a97d47f7c29695fe86bf7c9f58ed979503 WatchSource:0}: Error finding container 2b6bd7a833bbb7e7d9ff30faacee09a97d47f7c29695fe86bf7c9f58ed979503: Status 404 returned error can't find the container with id 2b6bd7a833bbb7e7d9ff30faacee09a97d47f7c29695fe86bf7c9f58ed979503
Jul 06 22:33:56.523651 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:33:56.523606    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t" event={"ID":"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6","Type":"ContainerStarted","Data":"2b6bd7a833bbb7e7d9ff30faacee09a97d47f7c29695fe86bf7c9f58ed979503"}
Jul 06 22:34:13.860558 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:13.860528    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc995648d-4jfb4"]
Jul 06 22:34:13.942641 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:13.942600    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc995648d-4jfb4"]
Jul 06 22:34:13.942848 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:13.942715    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023194 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023160    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023194 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023198    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8mg\" (UniqueName: \"kubernetes.io/projected/8198f59c-718c-4520-a2cb-a24ace2b806f-kube-api-access-6s8mg\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023446 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023228    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-oauth-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023446 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023317    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-console-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023446 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023389    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-oauth-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023594 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023451    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-trusted-ca-bundle\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.023594 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.023479    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-service-ca\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.124872 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124774    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-trusted-ca-bundle\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.124872 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124840    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-service-ca\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.124872 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124869    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125175 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124887    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8mg\" (UniqueName: \"kubernetes.io/projected/8198f59c-718c-4520-a2cb-a24ace2b806f-kube-api-access-6s8mg\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125175 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124916    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-oauth-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125175 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.124958    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-console-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125175 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.125012    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-oauth-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125718 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.125688    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-service-ca\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.125862 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.125778    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-trusted-ca-bundle\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.126884 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.126645    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-oauth-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.128224 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.128198    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8198f59c-718c-4520-a2cb-a24ace2b806f-console-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.129033 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.128986    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-oauth-config\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.129142 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.129059    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8198f59c-718c-4520-a2cb-a24ace2b806f-console-serving-cert\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.133715 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.133683    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8mg\" (UniqueName: \"kubernetes.io/projected/8198f59c-718c-4520-a2cb-a24ace2b806f-kube-api-access-6s8mg\") pod \"console-6fc995648d-4jfb4\" (UID: \"8198f59c-718c-4520-a2cb-a24ace2b806f\") " pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:14.253431 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:14.253355    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:16.675676 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:16.675653    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc995648d-4jfb4"]
Jul 06 22:34:16.679099 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:34:16.679071    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8198f59c_718c_4520_a2cb_a24ace2b806f.slice/crio-1a40c6a33db2fc3516539474ff64b91bcf2bd00bcbb9227ea16b3c9e564c197c WatchSource:0}: Error finding container 1a40c6a33db2fc3516539474ff64b91bcf2bd00bcbb9227ea16b3c9e564c197c: Status 404 returned error can't find the container with id 1a40c6a33db2fc3516539474ff64b91bcf2bd00bcbb9227ea16b3c9e564c197c
Jul 06 22:34:17.644948 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:17.644910    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc995648d-4jfb4" event={"ID":"8198f59c-718c-4520-a2cb-a24ace2b806f","Type":"ContainerStarted","Data":"e6cef88dd05c2b9ffec3f9d1aa7b1da11d3a0de818a6322043f711973fe413bd"}
Jul 06 22:34:17.645147 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:17.644965    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc995648d-4jfb4" event={"ID":"8198f59c-718c-4520-a2cb-a24ace2b806f","Type":"ContainerStarted","Data":"1a40c6a33db2fc3516539474ff64b91bcf2bd00bcbb9227ea16b3c9e564c197c"}
Jul 06 22:34:17.646287 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:17.646263    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t" event={"ID":"e3719a3d-b9d1-40fd-956b-b7a3723a0fb6","Type":"ContainerStarted","Data":"e65c9791476ff5494d7911a14a48e7a39e969ef5c40623433a772e5594ef49f8"}
Jul 06 22:34:17.662722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:17.662679    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc995648d-4jfb4" podStartSLOduration=4.662665788 podStartE2EDuration="4.662665788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:17.661149854 +0000 UTC m=+439.468896920" watchObservedRunningTime="2026-07-06 22:34:17.662665788 +0000 UTC m=+439.470412854"
Jul 06 22:34:17.676639 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:17.676596    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs26t" podStartSLOduration=1.770497247 podStartE2EDuration="22.676583478s" totalImagesPullingTime="20.906086231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:17.675352435 +0000 UTC m=+439.483099502" watchObservedRunningTime="2026-07-06 22:34:17.676583478 +0000 UTC m=+439.484330543"
Jul 06 22:34:24.254451 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:24.254363    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:24.254451 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:24.254451    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:24.259425 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:24.259396    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:24.687033 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:24.687001    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc995648d-4jfb4"
Jul 06 22:34:24.729650 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:24.729616    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:34:47.669860 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:47.669800    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:34:47.873276 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:47.873247    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:34:47.873435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:47.873355    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:47.873435 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:47.873391    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:34:47.875822 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:47.875787    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 22:34:48.014439 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.014349    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjz2r\" (UniqueName: \"kubernetes.io/projected/12465b51-a3b9-4d94-a196-0b606bfc2759-kube-api-access-qjz2r\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.014439 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.014413    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12465b51-a3b9-4d94-a196-0b606bfc2759-config-file\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.115343 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.115310    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12465b51-a3b9-4d94-a196-0b606bfc2759-config-file\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.115528 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.115390    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjz2r\" (UniqueName: \"kubernetes.io/projected/12465b51-a3b9-4d94-a196-0b606bfc2759-kube-api-access-qjz2r\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.115956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.115936    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12465b51-a3b9-4d94-a196-0b606bfc2759-config-file\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.124134 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.124106    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjz2r\" (UniqueName: \"kubernetes.io/projected/12465b51-a3b9-4d94-a196-0b606bfc2759-kube-api-access-qjz2r\") pod \"limitador-limitador-54d6d988d5-7ntfw\" (UID: \"12465b51-a3b9-4d94-a196-0b606bfc2759\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.154519 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.154492    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:48.184014 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.183977    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:48.245506 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.245474    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:48.245656 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.245569    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:48.248104 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.248085    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lkwzb\""
Jul 06 22:34:48.374479 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.374457    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:34:48.376271 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:34:48.376241    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12465b51_a3b9_4d94_a196_0b606bfc2759.slice/crio-520d39126fd9f8877f5fb4c91b890ad98ed656959e149848c1097e769320bdeb WatchSource:0}: Error finding container 520d39126fd9f8877f5fb4c91b890ad98ed656959e149848c1097e769320bdeb: Status 404 returned error can't find the container with id 520d39126fd9f8877f5fb4c91b890ad98ed656959e149848c1097e769320bdeb
Jul 06 22:34:48.418329 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.418300    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4vx\" (UniqueName: \"kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx\") pod \"authorino-58cd955675-757hn\" (UID: \"0b26b257-87a2-4882-90d6-542a6b8b1942\") " pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:48.519629 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.519586    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4vx\" (UniqueName: \"kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx\") pod \"authorino-58cd955675-757hn\" (UID: \"0b26b257-87a2-4882-90d6-542a6b8b1942\") " pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:48.527422 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.527396    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4vx\" (UniqueName: \"kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx\") pod \"authorino-58cd955675-757hn\" (UID: \"0b26b257-87a2-4882-90d6-542a6b8b1942\") " pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:48.569418 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.569344    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:48.693797 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.693777    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:48.695484 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:34:48.695454    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b26b257_87a2_4882_90d6_542a6b8b1942.slice/crio-39ae2e6959ef2e5e8721d9230981a1bc538327b7cf8752e5e04856a859bcfc68 WatchSource:0}: Error finding container 39ae2e6959ef2e5e8721d9230981a1bc538327b7cf8752e5e04856a859bcfc68: Status 404 returned error can't find the container with id 39ae2e6959ef2e5e8721d9230981a1bc538327b7cf8752e5e04856a859bcfc68
Jul 06 22:34:48.794674 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.794636    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw" event={"ID":"12465b51-a3b9-4d94-a196-0b606bfc2759","Type":"ContainerStarted","Data":"520d39126fd9f8877f5fb4c91b890ad98ed656959e149848c1097e769320bdeb"}
Jul 06 22:34:48.796254 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:48.796205    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-757hn" event={"ID":"0b26b257-87a2-4882-90d6-542a6b8b1942","Type":"ContainerStarted","Data":"39ae2e6959ef2e5e8721d9230981a1bc538327b7cf8752e5e04856a859bcfc68"}
Jul 06 22:34:49.752303 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:49.752151    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f9d779448-48prk" podUID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" containerName="console" containerID="cri-o://bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d" gracePeriod=15
Jul 06 22:34:49.809704 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:34:49.809660    2589 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cb8101_8ffd_4691_822b_0c1c6bd77807.slice/crio-conmon-bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cb8101_8ffd_4691_822b_0c1c6bd77807.slice/crio-bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d.scope\": RecentStats: unable to find data in memory cache]"
Jul 06 22:34:50.601706 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.601680    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:34:50.739412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739321    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739383    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739412 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739410    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7f9w\" (UniqueName: \"kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739434    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739469    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739497    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739691 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739590    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert\") pod \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\" (UID: \"d3cb8101-8ffd-4691-822b-0c1c6bd77807\") "
Jul 06 22:34:50.739959 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.739928    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:34:50.740039 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.740004    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:34:50.740357 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.740306    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config" (OuterVolumeSpecName: "console-config") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:34:50.740466 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.740364    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:34:50.742545 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.742503    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:34:50.742667 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.742578    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w" (OuterVolumeSpecName: "kube-api-access-p7f9w") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "kube-api-access-p7f9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:34:50.742667 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.742596    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3cb8101-8ffd-4691-822b-0c1c6bd77807" (UID: "d3cb8101-8ffd-4691-822b-0c1c6bd77807"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:34:50.809900 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.809856    2589 generic.go:356] "Generic (PLEG): container finished" podID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" containerID="bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d" exitCode=0
Jul 06 22:34:50.810349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.809910    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d779448-48prk"
Jul 06 22:34:50.810349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.809942    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d779448-48prk" event={"ID":"d3cb8101-8ffd-4691-822b-0c1c6bd77807","Type":"ContainerDied","Data":"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"}
Jul 06 22:34:50.810349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.810011    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d779448-48prk" event={"ID":"d3cb8101-8ffd-4691-822b-0c1c6bd77807","Type":"ContainerDied","Data":"a3b65dfcdd108777df70827ccd44681b64b561a0c7bce51f1c067281409bebad"}
Jul 06 22:34:50.810349 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.810044    2589 scope.go:117] "RemoveContainer" containerID="bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"
Jul 06 22:34:50.833155 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.833126    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:34:50.836043 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.836019    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9d779448-48prk"]
Jul 06 22:34:50.841068 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841046    2589 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841068 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841068    2589 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841079    2589 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841088    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7f9w\" (UniqueName: \"kubernetes.io/projected/d3cb8101-8ffd-4691-822b-0c1c6bd77807-kube-api-access-p7f9w\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841097    2589 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841106    2589 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:50.841215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:50.841114    2589 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3cb8101-8ffd-4691-822b-0c1c6bd77807-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:51.306696 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:51.306676    2589 scope.go:117] "RemoveContainer" containerID="bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"
Jul 06 22:34:51.307036 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:34:51.307014    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d\": container with ID starting with bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d not found: ID does not exist" containerID="bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"
Jul 06 22:34:51.307101 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:51.307046    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d"} err="failed to get container status \"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d\": rpc error: code = NotFound desc = could not find container \"bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d\": container with ID starting with bbe9a585ef5cac0ed83216f5147217cac142ff05dda09c3009f81f20225c0a3d not found: ID does not exist"
Jul 06 22:34:52.687396 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.687362    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" path="/var/lib/kubelet/pods/d3cb8101-8ffd-4691-822b-0c1c6bd77807/volumes"
Jul 06 22:34:52.825005 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.824962    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-757hn" event={"ID":"0b26b257-87a2-4882-90d6-542a6b8b1942","Type":"ContainerStarted","Data":"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"}
Jul 06 22:34:52.826654 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.826631    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw" event={"ID":"12465b51-a3b9-4d94-a196-0b606bfc2759","Type":"ContainerStarted","Data":"c89cbeb46c32e0f09f87d44b5e22029db2dc97ba4382f232091be69277695c40"}
Jul 06 22:34:52.826819 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.826744    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:34:52.842222 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.842169    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-757hn" podStartSLOduration=0.827135525 podStartE2EDuration="4.842153411s" totalImagesPullingTime="4.015017886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:52.840525502 +0000 UTC m=+474.648272572" watchObservedRunningTime="2026-07-06 22:34:52.842153411 +0000 UTC m=+474.649900476"
Jul 06 22:34:52.860264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:52.860205    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw" podStartSLOduration=1.52808361 podStartE2EDuration="5.860184458s" totalImagesPullingTime="4.332100848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:52.858884018 +0000 UTC m=+474.666631085" watchObservedRunningTime="2026-07-06 22:34:52.860184458 +0000 UTC m=+474.667931525"
Jul 06 22:34:53.197064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:53.197031    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:54.836600 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:54.836559    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-757hn" podUID="0b26b257-87a2-4882-90d6-542a6b8b1942" containerName="authorino" containerID="cri-o://e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5" gracePeriod=30
Jul 06 22:34:55.094771 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.094716    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:55.282037 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.282006    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n4vx\" (UniqueName: \"kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx\") pod \"0b26b257-87a2-4882-90d6-542a6b8b1942\" (UID: \"0b26b257-87a2-4882-90d6-542a6b8b1942\") "
Jul 06 22:34:55.284024 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.283999    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx" (OuterVolumeSpecName: "kube-api-access-6n4vx") pod "0b26b257-87a2-4882-90d6-542a6b8b1942" (UID: "0b26b257-87a2-4882-90d6-542a6b8b1942"). InnerVolumeSpecName "kube-api-access-6n4vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:34:55.383648 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.383549    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n4vx\" (UniqueName: \"kubernetes.io/projected/0b26b257-87a2-4882-90d6-542a6b8b1942-kube-api-access-6n4vx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:34:55.842363 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.842328    2589 generic.go:356] "Generic (PLEG): container finished" podID="0b26b257-87a2-4882-90d6-542a6b8b1942" containerID="e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5" exitCode=0
Jul 06 22:34:55.842753 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.842379    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-757hn"
Jul 06 22:34:55.842753 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.842410    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-757hn" event={"ID":"0b26b257-87a2-4882-90d6-542a6b8b1942","Type":"ContainerDied","Data":"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"}
Jul 06 22:34:55.842753 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.842451    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-757hn" event={"ID":"0b26b257-87a2-4882-90d6-542a6b8b1942","Type":"ContainerDied","Data":"39ae2e6959ef2e5e8721d9230981a1bc538327b7cf8752e5e04856a859bcfc68"}
Jul 06 22:34:55.842753 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.842467    2589 scope.go:117] "RemoveContainer" containerID="e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"
Jul 06 22:34:55.851227 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.851209    2589 scope.go:117] "RemoveContainer" containerID="e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"
Jul 06 22:34:55.851492 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:34:55.851474    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5\": container with ID starting with e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5 not found: ID does not exist" containerID="e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"
Jul 06 22:34:55.851535 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.851498    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5"} err="failed to get container status \"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5\": rpc error: code = NotFound desc = could not find container \"e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5\": container with ID starting with e67646f69f2dab3574f68f3357e017e1c5fc667c5e1b126b64ebce7a11d0f0d5 not found: ID does not exist"
Jul 06 22:34:55.862896 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.862873    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:55.864617 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:55.864601    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-757hn"]
Jul 06 22:34:56.687247 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:34:56.687212    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b26b257-87a2-4882-90d6-542a6b8b1942" path="/var/lib/kubelet/pods/0b26b257-87a2-4882-90d6-542a6b8b1942/volumes"
Jul 06 22:35:03.832342 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:03.832313    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"
Jul 06 22:35:19.850247 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850211    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850508    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" containerName="console"
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850519    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" containerName="console"
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850535    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b26b257-87a2-4882-90d6-542a6b8b1942" containerName="authorino"
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850541    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b26b257-87a2-4882-90d6-542a6b8b1942" containerName="authorino"
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850596    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cb8101-8ffd-4691-822b-0c1c6bd77807" containerName="console"
Jul 06 22:35:19.850642 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.850605    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b26b257-87a2-4882-90d6-542a6b8b1942" containerName="authorino"
Jul 06 22:35:19.854741 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.854726    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:19.857162 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.857137    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lkwzb\""
Jul 06 22:35:19.858245 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.858222    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:19.961731 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:19.961694    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chxsw\" (UniqueName: \"kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw\") pod \"authorino-5d4b67c446-6n5sr\" (UID: \"65cd4f82-fde5-48a3-b22d-c2d32d36f251\") " pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:20.062237 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.062205    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chxsw\" (UniqueName: \"kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw\") pod \"authorino-5d4b67c446-6n5sr\" (UID: \"65cd4f82-fde5-48a3-b22d-c2d32d36f251\") " pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:20.072831 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.072795    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chxsw\" (UniqueName: \"kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw\") pod \"authorino-5d4b67c446-6n5sr\" (UID: \"65cd4f82-fde5-48a3-b22d-c2d32d36f251\") " pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:20.083491 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.083467    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:20.083690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.083679    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:20.110845 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.110777    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6696c47bf6-k9rtl"]
Jul 06 22:35:20.114238 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.114220    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.120995 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.120973    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6696c47bf6-k9rtl"]
Jul 06 22:35:20.163082 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.163051    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrkpl\" (UniqueName: \"kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl\") pod \"authorino-6696c47bf6-k9rtl\" (UID: \"044c9a37-0bf3-4078-8335-2016ff15a735\") " pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.197044 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.197012    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6696c47bf6-k9rtl"]
Jul 06 22:35:20.197297 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:35:20.197275    2589 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jrkpl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6696c47bf6-k9rtl" podUID="044c9a37-0bf3-4078-8335-2016ff15a735"
Jul 06 22:35:20.219075 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.219046    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:20.221968 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.221942    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:35:20.223165 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:35:20.223143    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65cd4f82_fde5_48a3_b22d_c2d32d36f251.slice/crio-cc6b7a9897376dce458ebc815a7b53b7f50f2ff91d2676aaa37c4e4b420947fc WatchSource:0}: Error finding container cc6b7a9897376dce458ebc815a7b53b7f50f2ff91d2676aaa37c4e4b420947fc: Status 404 returned error can't find the container with id cc6b7a9897376dce458ebc815a7b53b7f50f2ff91d2676aaa37c4e4b420947fc
Jul 06 22:35:20.225687 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.225667    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.227904 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.227886    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 22:35:20.234466 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.234448    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:35:20.264302 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.264272    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvt78\" (UniqueName: \"kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.264436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.264313    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrkpl\" (UniqueName: \"kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl\") pod \"authorino-6696c47bf6-k9rtl\" (UID: \"044c9a37-0bf3-4078-8335-2016ff15a735\") " pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.264436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.264344    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.271944 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.271918    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrkpl\" (UniqueName: \"kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl\") pod \"authorino-6696c47bf6-k9rtl\" (UID: \"044c9a37-0bf3-4078-8335-2016ff15a735\") " pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.365759 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.365669    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.365759 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.365732    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvt78\" (UniqueName: \"kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.368151 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.368131    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.375462 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.375440    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvt78\" (UniqueName: \"kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78\") pod \"authorino-76bfd49544-wnvg8\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") " pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.538679 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.538650    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:35:20.671488 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.671461    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:35:20.673150 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:35:20.673121    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff84cb6d_9094_4b83_8306_e37de771a0cf.slice/crio-9bd1ca18fde40ead0d73fe858ed0086440dcbe6a61c07fb034480fbbaa06ed9a WatchSource:0}: Error finding container 9bd1ca18fde40ead0d73fe858ed0086440dcbe6a61c07fb034480fbbaa06ed9a: Status 404 returned error can't find the container with id 9bd1ca18fde40ead0d73fe858ed0086440dcbe6a61c07fb034480fbbaa06ed9a
Jul 06 22:35:20.967903 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.967800    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76bfd49544-wnvg8" event={"ID":"ff84cb6d-9094-4b83-8306-e37de771a0cf","Type":"ContainerStarted","Data":"9bd1ca18fde40ead0d73fe858ed0086440dcbe6a61c07fb034480fbbaa06ed9a"}
Jul 06 22:35:20.969161 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.969137    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" event={"ID":"65cd4f82-fde5-48a3-b22d-c2d32d36f251","Type":"ContainerStarted","Data":"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"}
Jul 06 22:35:20.969291 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.969166    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" event={"ID":"65cd4f82-fde5-48a3-b22d-c2d32d36f251","Type":"ContainerStarted","Data":"cc6b7a9897376dce458ebc815a7b53b7f50f2ff91d2676aaa37c4e4b420947fc"}
Jul 06 22:35:20.969291 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.969183    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.969401 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.969179    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" podUID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" containerName="authorino" containerID="cri-o://d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9" gracePeriod=30
Jul 06 22:35:20.976241 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.976222    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:20.984073 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:20.984034    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" podStartSLOduration=1.6703318409999999 podStartE2EDuration="1.984020317s" totalImagesPullingTime="313.688476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:35:20.98279705 +0000 UTC m=+502.790544107" watchObservedRunningTime="2026-07-06 22:35:20.984020317 +0000 UTC m=+502.791767383"
Jul 06 22:35:21.070913 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.070890    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrkpl\" (UniqueName: \"kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl\") pod \"044c9a37-0bf3-4078-8335-2016ff15a735\" (UID: \"044c9a37-0bf3-4078-8335-2016ff15a735\") "
Jul 06 22:35:21.072760 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.072735    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl" (OuterVolumeSpecName: "kube-api-access-jrkpl") pod "044c9a37-0bf3-4078-8335-2016ff15a735" (UID: "044c9a37-0bf3-4078-8335-2016ff15a735"). InnerVolumeSpecName "kube-api-access-jrkpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:35:21.172394 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.172364    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrkpl\" (UniqueName: \"kubernetes.io/projected/044c9a37-0bf3-4078-8335-2016ff15a735-kube-api-access-jrkpl\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:35:21.228398 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.228337    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:21.272699 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.272665    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chxsw\" (UniqueName: \"kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw\") pod \"65cd4f82-fde5-48a3-b22d-c2d32d36f251\" (UID: \"65cd4f82-fde5-48a3-b22d-c2d32d36f251\") "
Jul 06 22:35:21.274669 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.274641    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw" (OuterVolumeSpecName: "kube-api-access-chxsw") pod "65cd4f82-fde5-48a3-b22d-c2d32d36f251" (UID: "65cd4f82-fde5-48a3-b22d-c2d32d36f251"). InnerVolumeSpecName "kube-api-access-chxsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:35:21.373341 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.373308    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chxsw\" (UniqueName: \"kubernetes.io/projected/65cd4f82-fde5-48a3-b22d-c2d32d36f251-kube-api-access-chxsw\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:35:21.974761 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.974725    2589 generic.go:356] "Generic (PLEG): container finished" podID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" containerID="d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9" exitCode=0
Jul 06 22:35:21.975212 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.974765    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6n5sr"
Jul 06 22:35:21.975212 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.974824    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" event={"ID":"65cd4f82-fde5-48a3-b22d-c2d32d36f251","Type":"ContainerDied","Data":"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"}
Jul 06 22:35:21.975212 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.974869    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6n5sr" event={"ID":"65cd4f82-fde5-48a3-b22d-c2d32d36f251","Type":"ContainerDied","Data":"cc6b7a9897376dce458ebc815a7b53b7f50f2ff91d2676aaa37c4e4b420947fc"}
Jul 06 22:35:21.975212 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.974893    2589 scope.go:117] "RemoveContainer" containerID="d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"
Jul 06 22:35:21.976436 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.976405    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76bfd49544-wnvg8" event={"ID":"ff84cb6d-9094-4b83-8306-e37de771a0cf","Type":"ContainerStarted","Data":"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"}
Jul 06 22:35:21.976525 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.976476    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6696c47bf6-k9rtl"
Jul 06 22:35:21.984275 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.984256    2589 scope.go:117] "RemoveContainer" containerID="d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"
Jul 06 22:35:21.984650 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:35:21.984518    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9\": container with ID starting with d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9 not found: ID does not exist" containerID="d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"
Jul 06 22:35:21.984650 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.984544    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9"} err="failed to get container status \"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9\": rpc error: code = NotFound desc = could not find container \"d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9\": container with ID starting with d2dbace1b20a457f1699b74fe169615482259ea829e0bc05f3c3cae6a72155c9 not found: ID does not exist"
Jul 06 22:35:21.993216 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:21.993177    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76bfd49544-wnvg8" podStartSLOduration=1.648769541 podStartE2EDuration="1.993158544s" totalImagesPullingTime="344.389003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:35:21.992083418 +0000 UTC m=+503.799830484" watchObservedRunningTime="2026-07-06 22:35:21.993158544 +0000 UTC m=+503.800905635"
Jul 06 22:35:22.017222 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.017198    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6696c47bf6-k9rtl"]
Jul 06 22:35:22.024966 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.024939    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6696c47bf6-k9rtl"]
Jul 06 22:35:22.042267 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.042243    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:22.045859 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.045835    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6n5sr"]
Jul 06 22:35:22.688071 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.688030    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044c9a37-0bf3-4078-8335-2016ff15a735" path="/var/lib/kubelet/pods/044c9a37-0bf3-4078-8335-2016ff15a735/volumes"
Jul 06 22:35:22.688322 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:22.688305    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" path="/var/lib/kubelet/pods/65cd4f82-fde5-48a3-b22d-c2d32d36f251/volumes"
Jul 06 22:35:58.671665 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:35:58.671588    2589 scope.go:117] "RemoveContainer" containerID="b45bbc94042688a363cd953786587780b669717d71980504a91e6c697f610991"
Jul 06 22:36:05.267645 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:36:05.267608    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:36:48.981596 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:36:48.981563    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:36:57.392569 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:36:57.392530    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:36:58.660998 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:36:58.660973    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:36:58.671094 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:36:58.671073    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:37:17.584079 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:17.584039    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:37:26.588423 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:26.588333    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:37:34.488755 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:34.488705    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:37:35.289379 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.289348    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"]
Jul 06 22:37:35.289660 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.289648    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" containerName="authorino"
Jul 06 22:37:35.289660 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.289661    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" containerName="authorino"
Jul 06 22:37:35.289750 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.289715    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="65cd4f82-fde5-48a3-b22d-c2d32d36f251" containerName="authorino"
Jul 06 22:37:35.292648 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.292633    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.296301 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.296274    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5xqsk\""
Jul 06 22:37:35.296548 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.296280    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 22:37:35.296634 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.296281    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 22:37:35.296692 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.296315    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 22:37:35.303923 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.303896    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"]
Jul 06 22:37:35.367211 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367174    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0af06060-f5d7-44dc-bd8a-98e979668856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.367411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367240    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.367411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367287    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.367411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367316    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.367576 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367405    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.367576 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.367445    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7bc\" (UniqueName: \"kubernetes.io/projected/0af06060-f5d7-44dc-bd8a-98e979668856-kube-api-access-zp7bc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468459 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468418    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0af06060-f5d7-44dc-bd8a-98e979668856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468477    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468521    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468551    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468585    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.468720 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468625    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7bc\" (UniqueName: \"kubernetes.io/projected/0af06060-f5d7-44dc-bd8a-98e979668856-kube-api-access-zp7bc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.469019 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468932    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.469019 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.468993    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.469091 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.469046    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.470717 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.470698    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0af06060-f5d7-44dc-bd8a-98e979668856-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.471103 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.471077    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0af06060-f5d7-44dc-bd8a-98e979668856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.476309 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.476285    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7bc\" (UniqueName: \"kubernetes.io/projected/0af06060-f5d7-44dc-bd8a-98e979668856-kube-api-access-zp7bc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24\" (UID: \"0af06060-f5d7-44dc-bd8a-98e979668856\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.603506 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.603427    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:35.750070 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.750044    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"]
Jul 06 22:37:35.751258 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:37:35.751227    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0af06060_f5d7_44dc_bd8a_98e979668856.slice/crio-adbc6a75de455ad855c9241b777b8dc9e6de061ad16c587b268e1baa58426311 WatchSource:0}: Error finding container adbc6a75de455ad855c9241b777b8dc9e6de061ad16c587b268e1baa58426311: Status 404 returned error can't find the container with id adbc6a75de455ad855c9241b777b8dc9e6de061ad16c587b268e1baa58426311
Jul 06 22:37:35.752515 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:35.752494    2589 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:37:36.637141 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:36.637097    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24" event={"ID":"0af06060-f5d7-44dc-bd8a-98e979668856","Type":"ContainerStarted","Data":"adbc6a75de455ad855c9241b777b8dc9e6de061ad16c587b268e1baa58426311"}
Jul 06 22:37:37.642999 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:37.642955    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24" event={"ID":"0af06060-f5d7-44dc-bd8a-98e979668856","Type":"ContainerStarted","Data":"14a1deb68e2283415e4aee14d39c2fd89186a00e21389984891daf887ced4d85"}
Jul 06 22:37:37.659747 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:37.659697    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24" podStartSLOduration=1.661455373 podStartE2EDuration="2.659682039s" totalImagesPullingTime="998.226666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:37:37.658645625 +0000 UTC m=+639.466392691" watchObservedRunningTime="2026-07-06 22:37:37.659682039 +0000 UTC m=+639.467429159"
Jul 06 22:37:43.686656 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:43.686622    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:37:45.604569 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:45.604528    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:45.604980 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:45.604591    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:45.617468 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:45.617444    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:37:45.693363 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:37:45.693336    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24"
Jul 06 22:38:30.935330 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:30.935290    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-759b74bccc-qtxk2"]
Jul 06 22:38:30.938516 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:30.938496    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:30.947048 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:30.947025    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759b74bccc-qtxk2"]
Jul 06 22:38:31.029990 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.029954    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjc9\" (UniqueName: \"kubernetes.io/projected/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-kube-api-access-qgjc9\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.030152 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.030017    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-tls-cert\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.131335 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.131300    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjc9\" (UniqueName: \"kubernetes.io/projected/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-kube-api-access-qgjc9\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.131467 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.131357    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-tls-cert\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.133756 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.133737    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-tls-cert\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.138955 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.138928    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjc9\" (UniqueName: \"kubernetes.io/projected/6815bc7e-2ba8-4805-b2f7-70d3dc8aed61-kube-api-access-qgjc9\") pod \"authorino-759b74bccc-qtxk2\" (UID: \"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61\") " pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.247747 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.247655    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759b74bccc-qtxk2"
Jul 06 22:38:31.379644 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.379592    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759b74bccc-qtxk2"]
Jul 06 22:38:31.381837 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:38:31.381787    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6815bc7e_2ba8_4805_b2f7_70d3dc8aed61.slice/crio-3e1c9a54fb58ce3a3d6bbd7543fc503d6e9bbe525959bb831510218dfe9cb1ba WatchSource:0}: Error finding container 3e1c9a54fb58ce3a3d6bbd7543fc503d6e9bbe525959bb831510218dfe9cb1ba: Status 404 returned error can't find the container with id 3e1c9a54fb58ce3a3d6bbd7543fc503d6e9bbe525959bb831510218dfe9cb1ba
Jul 06 22:38:31.896058 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.896023    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759b74bccc-qtxk2" event={"ID":"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61","Type":"ContainerStarted","Data":"34c37e492021ea0e3d54e3187dc73323c03b09e0ff28fb6716d99e6c3ce8b7ef"}
Jul 06 22:38:31.896205 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.896069    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759b74bccc-qtxk2" event={"ID":"6815bc7e-2ba8-4805-b2f7-70d3dc8aed61","Type":"ContainerStarted","Data":"3e1c9a54fb58ce3a3d6bbd7543fc503d6e9bbe525959bb831510218dfe9cb1ba"}
Jul 06 22:38:31.914451 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.914396    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-759b74bccc-qtxk2" podStartSLOduration=1.510555998 podStartE2EDuration="1.914374539s" totalImagesPullingTime="403.818541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:38:31.912176901 +0000 UTC m=+693.719923961" watchObservedRunningTime="2026-07-06 22:38:31.914374539 +0000 UTC m=+693.722121610"
Jul 06 22:38:31.938798 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.938755    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:38:31.939508 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:31.939471    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76bfd49544-wnvg8" podUID="ff84cb6d-9094-4b83-8306-e37de771a0cf" containerName="authorino" containerID="cri-o://d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d" gracePeriod=30
Jul 06 22:38:32.185763 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.185733    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:38:32.242561 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.242520    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvt78\" (UniqueName: \"kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78\") pod \"ff84cb6d-9094-4b83-8306-e37de771a0cf\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") "
Jul 06 22:38:32.242740 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.242567    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert\") pod \"ff84cb6d-9094-4b83-8306-e37de771a0cf\" (UID: \"ff84cb6d-9094-4b83-8306-e37de771a0cf\") "
Jul 06 22:38:32.244663 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.244635    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78" (OuterVolumeSpecName: "kube-api-access-hvt78") pod "ff84cb6d-9094-4b83-8306-e37de771a0cf" (UID: "ff84cb6d-9094-4b83-8306-e37de771a0cf"). InnerVolumeSpecName "kube-api-access-hvt78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:38:32.252269 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.252246    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ff84cb6d-9094-4b83-8306-e37de771a0cf" (UID: "ff84cb6d-9094-4b83-8306-e37de771a0cf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:38:32.343987 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.343905    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvt78\" (UniqueName: \"kubernetes.io/projected/ff84cb6d-9094-4b83-8306-e37de771a0cf-kube-api-access-hvt78\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:38:32.343987 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.343936    2589 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff84cb6d-9094-4b83-8306-e37de771a0cf-tls-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:38:32.902411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.902368    2589 generic.go:356] "Generic (PLEG): container finished" podID="ff84cb6d-9094-4b83-8306-e37de771a0cf" containerID="d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d" exitCode=0
Jul 06 22:38:32.902411 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.902411    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76bfd49544-wnvg8"
Jul 06 22:38:32.902643 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.902443    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76bfd49544-wnvg8" event={"ID":"ff84cb6d-9094-4b83-8306-e37de771a0cf","Type":"ContainerDied","Data":"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"}
Jul 06 22:38:32.902643 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.902484    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76bfd49544-wnvg8" event={"ID":"ff84cb6d-9094-4b83-8306-e37de771a0cf","Type":"ContainerDied","Data":"9bd1ca18fde40ead0d73fe858ed0086440dcbe6a61c07fb034480fbbaa06ed9a"}
Jul 06 22:38:32.902643 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.902509    2589 scope.go:117] "RemoveContainer" containerID="d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"
Jul 06 22:38:32.911621 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.911592    2589 scope.go:117] "RemoveContainer" containerID="d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"
Jul 06 22:38:32.911896 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:38:32.911875    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d\": container with ID starting with d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d not found: ID does not exist" containerID="d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"
Jul 06 22:38:32.911984 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.911900    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d"} err="failed to get container status \"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d\": rpc error: code = NotFound desc = could not find container \"d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d\": container with ID starting with d5be45c3383b70a5524d6393294052129735fdc5e1086a3cb18d31deea99238d not found: ID does not exist"
Jul 06 22:38:32.921880 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.921855    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:38:32.928200 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:32.928180    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76bfd49544-wnvg8"]
Jul 06 22:38:34.687517 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:34.687482    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff84cb6d-9094-4b83-8306-e37de771a0cf" path="/var/lib/kubelet/pods/ff84cb6d-9094-4b83-8306-e37de771a0cf/volumes"
Jul 06 22:38:59.489565 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:38:59.489530    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:39:10.186926 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:39:10.186889    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:39:20.590541 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:39:20.590502    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:39:29.898215 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:39:29.898184    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:39:40.296842 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:39:40.296792    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:40:48.195670 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:40:48.195584    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:40:57.984238 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:40:57.984197    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:06.597792 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:06.597737    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:15.504970 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:15.504929    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:26.088555 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:26.088520    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:35.690182 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:35.690148    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:47.205630 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:47.205585    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:56.687433 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:56.687401    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:41:58.700043 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:58.700018    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:41:58.707083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:41:58.707063    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:42:19.187399 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:42:19.187365    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:42:31.789895 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:42:31.789859    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:42:52.882536 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:42:52.882501    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:03.190657 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:03.190620    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:20.295312 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:20.295271    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:29.501762 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:29.501677    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:39.990122 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:39.990083    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:49.182675 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:49.182639    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:43:57.683122 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:43:57.683076    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:45:47.681993 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:45:47.681954    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:45:56.385744 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:45:56.385705    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:11.181346 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:11.181305    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:21.402174 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:21.402096    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:32.592202 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:32.592166    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:42.687197 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:42.687167    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:51.691662 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:51.691627    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:46:58.732785 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:58.732756    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:46:58.735935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:46:58.735915    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:47:01.988786 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:47:01.988748    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:47:13.286752 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:47:13.286714    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:47:22.588477 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:47:22.588444    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:47:32.595684 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:47:32.595649    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:47:57.997585 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:47:57.997548    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:04.889649 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:04.889608    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:14.095697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:14.095658    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:25.389029 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:25.388994    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:32.687443 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:32.687411    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:45.882652 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:45.882614    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:48:54.687427 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:48:54.687397    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:03.492044 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:03.492007    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:13.283995 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:13.283960    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:22.188747 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:22.188663    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:31.490259 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:31.490220    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:45.280539 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:45.280507    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:49:53.489323 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:49:53.489285    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:03.893875 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:03.893835    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:15.687023 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:15.686982    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:26.484332 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:26.484294    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:34.091702 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:34.089896    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:46.386582 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:46.386545    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:50:58.787657 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:50:58.787581    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:51:08.885820 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:08.885777    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:51:22.288921 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:22.288886    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:51:31.203027 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:31.202996    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:51:42.184365 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:42.184326    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:51:58.764996 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:58.764917    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:51:58.765866 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:58.765846    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:51:58.793803 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:51:58.793779    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:52:10.495189 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:52:10.495155    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:52:18.095179 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:52:18.095141    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:52:26.735791 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:52:26.735757    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:53:51.688934 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:53:51.688854    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:54:00.998197 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:54:00.998161    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:54:12.289504 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:54:12.289464    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:54:23.204307 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:54:23.204273    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:54:57.395269 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:54:57.395230    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:55:01.781391 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.781360    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:55:01.781842 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.781664    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff84cb6d-9094-4b83-8306-e37de771a0cf" containerName="authorino"
Jul 06 22:55:01.781842 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.781676    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff84cb6d-9094-4b83-8306-e37de771a0cf" containerName="authorino"
Jul 06 22:55:01.781842 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.781736    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff84cb6d-9094-4b83-8306-e37de771a0cf" containerName="authorino"
Jul 06 22:55:01.784555 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.784539    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.788956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.788921    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2513e2ce\"/\"openshift-service-ca.crt\""
Jul 06 22:55:01.788956 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.788921    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2513e2ce\"/\"kube-root-ca.crt\""
Jul 06 22:55:01.789161 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.788994    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2513e2ce\"/\"e2e-lifecycle-model-2513e2ce-kserve-self-signed-certs\""
Jul 06 22:55:01.789161 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.789002    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2513e2ce\"/\"default-dockercfg-k4vgj\""
Jul 06 22:55:01.798767 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.798743    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:55:01.825065 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825036    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.825065 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825066    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.825306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825094    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.825306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825152    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbt82\" (UniqueName: \"kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.825306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825211    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.825306 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.825251    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926111 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926078    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926111 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926115    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926337 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926149    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926337 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926185    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbt82\" (UniqueName: \"kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926337 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926216    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926492 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926349    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926620 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926602    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926690 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926650    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.926747 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.926703    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.928389 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.928373    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.928664 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.928646    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:01.935899 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:01.935879    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbt82\" (UniqueName: \"kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82\") pod \"e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") " pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:02.093695 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:02.093600    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:02.249198 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:02.249175    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:55:02.251309 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:55:02.251283    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd97e83e_f1a3_440a_acb2_12ae860f1519.slice/crio-dedc270c6a4d31069b338566799b8afeb454d12043bab4ffc87a9ef24354d231 WatchSource:0}: Error finding container dedc270c6a4d31069b338566799b8afeb454d12043bab4ffc87a9ef24354d231: Status 404 returned error can't find the container with id dedc270c6a4d31069b338566799b8afeb454d12043bab4ffc87a9ef24354d231
Jul 06 22:55:02.719347 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:02.719304    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" event={"ID":"cd97e83e-f1a3-440a-acb2-12ae860f1519","Type":"ContainerStarted","Data":"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"}
Jul 06 22:55:02.719347 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:02.719351    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" event={"ID":"cd97e83e-f1a3-440a-acb2-12ae860f1519","Type":"ContainerStarted","Data":"dedc270c6a4d31069b338566799b8afeb454d12043bab4ffc87a9ef24354d231"}
Jul 06 22:55:02.739697 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:02.739648    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" podStartSLOduration=1.7396338660000001 podStartE2EDuration="1.739633866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:02.737528318 +0000 UTC m=+1684.545275384" watchObservedRunningTime="2026-07-06 22:55:02.739633866 +0000 UTC m=+1684.547380966"
Jul 06 22:55:05.998874 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:05.998835    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:55:12.094270 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:12.094233    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:12.094790 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:12.094293    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:12.106989 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:12.106965    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:12.775318 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:12.775284    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:26.892680 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:26.892599    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:55:36.690456 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:36.690423    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:55:43.552787 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:43.552749    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:55:46.484980 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:46.484941    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:55:58.572874 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.572828    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" podUID="cd97e83e-f1a3-440a-acb2-12ae860f1519" containerName="main" containerID="cri-o://c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0" gracePeriod=45
Jul 06 22:55:58.815759 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.815735    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:58.890871 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.890767    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.890871 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.890833    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.891083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.890885    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbt82\" (UniqueName: \"kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.891083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.890915    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.891083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.890958    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.891083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891012    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm\") pod \"cd97e83e-f1a3-440a-acb2-12ae860f1519\" (UID: \"cd97e83e-f1a3-440a-acb2-12ae860f1519\") "
Jul 06 22:55:58.891083 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891016    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:55:58.891339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891131    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home" (OuterVolumeSpecName: "home") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:55:58.891339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891206    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:55:58.891339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891245    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.891339 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.891258    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.893064 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.893042    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:55:58.893172 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.893083    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm" (OuterVolumeSpecName: "dshm") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:55:58.893172 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.893088    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82" (OuterVolumeSpecName: "kube-api-access-wbt82") pod "cd97e83e-f1a3-440a-acb2-12ae860f1519" (UID: "cd97e83e-f1a3-440a-acb2-12ae860f1519"). InnerVolumeSpecName "kube-api-access-wbt82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:55:58.988039 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.988004    2589 generic.go:356] "Generic (PLEG): container finished" podID="cd97e83e-f1a3-440a-acb2-12ae860f1519" containerID="c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0" exitCode=0
Jul 06 22:55:58.988199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.988046    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"
Jul 06 22:55:58.988199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.988072    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" event={"ID":"cd97e83e-f1a3-440a-acb2-12ae860f1519","Type":"ContainerDied","Data":"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"}
Jul 06 22:55:58.988199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.988102    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r" event={"ID":"cd97e83e-f1a3-440a-acb2-12ae860f1519","Type":"ContainerDied","Data":"dedc270c6a4d31069b338566799b8afeb454d12043bab4ffc87a9ef24354d231"}
Jul 06 22:55:58.988199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.988119    2589 scope.go:117] "RemoveContainer" containerID="c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"
Jul 06 22:55:58.993375 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.993345    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbt82\" (UniqueName: \"kubernetes.io/projected/cd97e83e-f1a3-440a-acb2-12ae860f1519-kube-api-access-wbt82\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.993509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.993380    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd97e83e-f1a3-440a-acb2-12ae860f1519-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.993509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.993401    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.993509 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.993421    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd97e83e-f1a3-440a-acb2-12ae860f1519-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:55:58.999254 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.999236    2589 scope.go:117] "RemoveContainer" containerID="c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"
Jul 06 22:55:58.999558 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:55:58.999539    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0\": container with ID starting with c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0 not found: ID does not exist" containerID="c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"
Jul 06 22:55:58.999629 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:58.999570    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0"} err="failed to get container status \"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0\": rpc error: code = NotFound desc = could not find container \"c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0\": container with ID starting with c9d3cf289b2370d9aa95638cd102270269171d84d195e3063bd0080eca6455d0 not found: ID does not exist"
Jul 06 22:55:59.016839 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:59.016791    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:55:59.019910 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:55:59.019891    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2513e2ce/e2e-lifecycle-model-2513e2ce-kserve-5784b756bc-pph2r"]
Jul 06 22:56:00.687756 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:00.687710    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd97e83e-f1a3-440a-acb2-12ae860f1519" path="/var/lib/kubelet/pods/cd97e83e-f1a3-440a-acb2-12ae860f1519/volumes"
Jul 06 22:56:22.691513 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:22.691478    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:56:36.795311 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:36.795265    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:56:50.590928 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:50.590891    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:56:58.797334 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:58.797307    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:56:58.797826 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:56:58.797623    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 22:57:35.982668 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:57:35.982629    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:57:47.592345 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:57:47.592306    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:58:13.091053 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.091019    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:58:13.091513 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.091321    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd97e83e-f1a3-440a-acb2-12ae860f1519" containerName="main"
Jul 06 22:58:13.091513 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.091333    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd97e83e-f1a3-440a-acb2-12ae860f1519" containerName="main"
Jul 06 22:58:13.091513 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.091402    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd97e83e-f1a3-440a-acb2-12ae860f1519" containerName="main"
Jul 06 22:58:13.094332 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.094317    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.097935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.097911    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6d2b52\"/\"openshift-service-ca.crt\""
Jul 06 22:58:13.097935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.097931    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6d2b52\"/\"kube-root-ca.crt\""
Jul 06 22:58:13.098136 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.097939    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6d2b52\"/\"test-model-6d2b52-kserve-self-signed-certs\""
Jul 06 22:58:13.098136 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.097981    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6d2b52\"/\"default-dockercfg-62cp8\""
Jul 06 22:58:13.104722 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.104703    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:58:13.233443 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233402    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.233443 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233445    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.233661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233494    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.233661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233531    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bfpz\" (UniqueName: \"kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.233661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233569    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.233661 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.233584    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334735 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334681    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334735 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334737    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bfpz\" (UniqueName: \"kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334771    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334786    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334882    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.334971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.334905    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.335207 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.335178    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.335272 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.335207    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.335354 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.335331    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.337165 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.337144    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.337331 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.337313    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.342855 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.342781    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bfpz\" (UniqueName: \"kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz\") pod \"test-model-6d2b52-kserve-599dc498dc-mtxjm\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") " pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.403506 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.403478    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:13.533413 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.533386    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:58:13.535685 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:58:13.535641    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52eaed8e_057f_45fd_832a_db7733fe02d8.slice/crio-cbd51054c3bad122766ce0b1a541460a2be8d340b35c78902788de602ae69b3c WatchSource:0}: Error finding container cbd51054c3bad122766ce0b1a541460a2be8d340b35c78902788de602ae69b3c: Status 404 returned error can't find the container with id cbd51054c3bad122766ce0b1a541460a2be8d340b35c78902788de602ae69b3c
Jul 06 22:58:13.632012 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.631973    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" event={"ID":"52eaed8e-057f-45fd-832a-db7733fe02d8","Type":"ContainerStarted","Data":"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"}
Jul 06 22:58:13.632171 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.632020    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" event={"ID":"52eaed8e-057f-45fd-832a-db7733fe02d8","Type":"ContainerStarted","Data":"cbd51054c3bad122766ce0b1a541460a2be8d340b35c78902788de602ae69b3c"}
Jul 06 22:58:13.650935 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:13.650889    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" podStartSLOduration=0.650874296 podStartE2EDuration="650.874296ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:13.648986434 +0000 UTC m=+1875.456733525" watchObservedRunningTime="2026-07-06 22:58:13.650874296 +0000 UTC m=+1875.458621362"
Jul 06 22:58:17.388429 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:17.388386    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:58:23.404532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:23.404440    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:23.404532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:23.404502    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:23.417356 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:23.417326    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:23.690571 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:23.690486    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:58:39.112199 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.112166    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:58:39.115376 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.115361    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.117846 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.117826    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-63da37\"/\"kube-root-ca.crt\""
Jul 06 22:58:39.117940 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.117825    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-63da37\"/\"default-dockercfg-5hlq5\""
Jul 06 22:58:39.118944 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.118926    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-63da37\"/\"openshift-service-ca.crt\""
Jul 06 22:58:39.119077 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.119059    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-63da37\"/\"test-model-63da37-kserve-self-signed-certs\""
Jul 06 22:58:39.124508 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.124487    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:58:39.147648 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147622    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.147781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147657    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.147781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147674    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65fg\" (UniqueName: \"kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.147781 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147755    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.148010 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147820    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.148010 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.147862    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.248900 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.248871    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.248932    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.248960    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.248983    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65fg\" (UniqueName: \"kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249098 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.249006    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.249145    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.249310    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249383 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.249338    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.249471 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.249455    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.251255 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.251227    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.251508 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.251491    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.256329 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.256312    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65fg\" (UniqueName: \"kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg\") pod \"test-model-63da37-kserve-7598df5fb5-ltrrp\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") " pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.426646 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.426556    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:39.561862 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.561835    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:58:39.564069 ip-10-0-135-240 kubenswrapper[2589]: W0706 22:58:39.564038    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28e7fcdc_7ed3_4e0a_9682_0d0d828f2b4b.slice/crio-516dc130db0dd7c846d4b30fb412414582c2407fd88ad4887d4c84ae8b8afc81 WatchSource:0}: Error finding container 516dc130db0dd7c846d4b30fb412414582c2407fd88ad4887d4c84ae8b8afc81: Status 404 returned error can't find the container with id 516dc130db0dd7c846d4b30fb412414582c2407fd88ad4887d4c84ae8b8afc81
Jul 06 22:58:39.757971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.757868    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" event={"ID":"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b","Type":"ContainerStarted","Data":"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"}
Jul 06 22:58:39.757971 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.757911    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" event={"ID":"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b","Type":"ContainerStarted","Data":"516dc130db0dd7c846d4b30fb412414582c2407fd88ad4887d4c84ae8b8afc81"}
Jul 06 22:58:39.775313 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:39.775264    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" podStartSLOduration=0.775249063 podStartE2EDuration="775.249063ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:39.774298463 +0000 UTC m=+1901.582045540" watchObservedRunningTime="2026-07-06 22:58:39.775249063 +0000 UTC m=+1901.582996129"
Jul 06 22:58:44.902505 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:44.902466    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:58:49.427220 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:49.427181    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:49.427611 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:49.427234    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:49.439637 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:49.439615    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:58:49.821331 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:58:49.821304    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:59:22.105836 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:22.105793    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:59:23.269261 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:23.269230    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:59:26.679880 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:26.679844    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 22:59:37.126005 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.125940    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" podUID="52eaed8e-057f-45fd-832a-db7733fe02d8" containerName="main" containerID="cri-o://4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9" gracePeriod=45
Jul 06 22:59:37.368110 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.368080    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:59:37.451712 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451623    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.451712 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451672    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.451712 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451706    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.452036 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451768    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.452036 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451798    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.452036 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.451852    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bfpz\" (UniqueName: \"kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz\") pod \"52eaed8e-057f-45fd-832a-db7733fe02d8\" (UID: \"52eaed8e-057f-45fd-832a-db7733fe02d8\") "
Jul 06 22:59:37.452036 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.452003    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:37.452232 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.452087    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home" (OuterVolumeSpecName: "home") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:37.452232 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.452107    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:37.452232 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.452164    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:37.454022 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.453999    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm" (OuterVolumeSpecName: "dshm") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:37.454132 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.454057    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz" (OuterVolumeSpecName: "kube-api-access-4bfpz") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "kube-api-access-4bfpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:59:37.454132 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.454110    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "52eaed8e-057f-45fd-832a-db7733fe02d8" (UID: "52eaed8e-057f-45fd-832a-db7733fe02d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:59:37.552759 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.552721    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:37.552759 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.552753    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:37.552986 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.552767    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52eaed8e-057f-45fd-832a-db7733fe02d8-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:37.552986 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.552781    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bfpz\" (UniqueName: \"kubernetes.io/projected/52eaed8e-057f-45fd-832a-db7733fe02d8-kube-api-access-4bfpz\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:37.552986 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:37.552792    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52eaed8e-057f-45fd-832a-db7733fe02d8-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.051655 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.051619    2589 generic.go:356] "Generic (PLEG): container finished" podID="52eaed8e-057f-45fd-832a-db7733fe02d8" containerID="4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9" exitCode=0
Jul 06 22:59:38.051879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.051660    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"
Jul 06 22:59:38.051879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.051704    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" event={"ID":"52eaed8e-057f-45fd-832a-db7733fe02d8","Type":"ContainerDied","Data":"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"}
Jul 06 22:59:38.051879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.051752    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm" event={"ID":"52eaed8e-057f-45fd-832a-db7733fe02d8","Type":"ContainerDied","Data":"cbd51054c3bad122766ce0b1a541460a2be8d340b35c78902788de602ae69b3c"}
Jul 06 22:59:38.051879 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.051776    2589 scope.go:117] "RemoveContainer" containerID="4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"
Jul 06 22:59:38.060532 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.060515    2589 scope.go:117] "RemoveContainer" containerID="4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"
Jul 06 22:59:38.060782 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:59:38.060761    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9\": container with ID starting with 4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9 not found: ID does not exist" containerID="4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"
Jul 06 22:59:38.060870 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.060794    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9"} err="failed to get container status \"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9\": rpc error: code = NotFound desc = could not find container \"4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9\": container with ID starting with 4c80f7d58ddd22b3650121b22d249dc1e360954ddec9472328d8989032ea2bd9 not found: ID does not exist"
Jul 06 22:59:38.072119 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.072097    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:59:38.076832 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.076798    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6d2b52/test-model-6d2b52-kserve-599dc498dc-mtxjm"]
Jul 06 22:59:38.289683 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.289644    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" podUID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" containerName="main" containerID="cri-o://45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62" gracePeriod=45
Jul 06 22:59:38.542245 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.542221    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:59:38.561140 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561073    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561140    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561190    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561264 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561231    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561444 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561271    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561444 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561318    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g65fg\" (UniqueName: \"kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg\") pod \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\" (UID: \"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b\") "
Jul 06 22:59:38.561552 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561516    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home" (OuterVolumeSpecName: "home") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:38.561552 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.561539    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:38.562088 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.562044    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:38.563746 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.563719    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm" (OuterVolumeSpecName: "dshm") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:59:38.563874 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.563723    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:59:38.563874 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.563782    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg" (OuterVolumeSpecName: "kube-api-access-g65fg") pod "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" (UID: "28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b"). InnerVolumeSpecName "kube-api-access-g65fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:59:38.662059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662029    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.662059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662052    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.662059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662061    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.662059 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662069    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.662318 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662077    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g65fg\" (UniqueName: \"kubernetes.io/projected/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-kube-api-access-g65fg\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.662318 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.662085    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 22:59:38.693329 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:38.693293    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52eaed8e-057f-45fd-832a-db7733fe02d8" path="/var/lib/kubelet/pods/52eaed8e-057f-45fd-832a-db7733fe02d8/volumes"
Jul 06 22:59:39.058208 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.058176    2589 generic.go:356] "Generic (PLEG): container finished" podID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" containerID="45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62" exitCode=0
Jul 06 22:59:39.058364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.058211    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" event={"ID":"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b","Type":"ContainerDied","Data":"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"}
Jul 06 22:59:39.058364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.058231    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"
Jul 06 22:59:39.058364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.058239    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp" event={"ID":"28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b","Type":"ContainerDied","Data":"516dc130db0dd7c846d4b30fb412414582c2407fd88ad4887d4c84ae8b8afc81"}
Jul 06 22:59:39.058364 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.058257    2589 scope.go:117] "RemoveContainer" containerID="45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"
Jul 06 22:59:39.069452 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.069428    2589 scope.go:117] "RemoveContainer" containerID="45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"
Jul 06 22:59:39.069709 ip-10-0-135-240 kubenswrapper[2589]: E0706 22:59:39.069688    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62\": container with ID starting with 45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62 not found: ID does not exist" containerID="45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"
Jul 06 22:59:39.069778 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.069716    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62"} err="failed to get container status \"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62\": rpc error: code = NotFound desc = could not find container \"45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62\": container with ID starting with 45e0400fd7a1320a510f81cbabb6bc102ee253cdee442a8feb60c88898fefb62 not found: ID does not exist"
Jul 06 22:59:39.073894 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.073873    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:59:39.077161 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:39.077140    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-63da37/test-model-63da37-kserve-7598df5fb5-ltrrp"]
Jul 06 22:59:40.687702 ip-10-0-135-240 kubenswrapper[2589]: I0706 22:59:40.687669    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" path="/var/lib/kubelet/pods/28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b/volumes"
Jul 06 23:00:00.140337 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140308    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-ct57k"]
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140639    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" containerName="main"
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140650    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" containerName="main"
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140664    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52eaed8e-057f-45fd-832a-db7733fe02d8" containerName="main"
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140669    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="52eaed8e-057f-45fd-832a-db7733fe02d8" containerName="main"
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140716    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="52eaed8e-057f-45fd-832a-db7733fe02d8" containerName="main"
Jul 06 23:00:00.140744 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.140728    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e7fcdc-7ed3-4e0a-9682-0d0d828f2b4b" containerName="main"
Jul 06 23:00:00.145052 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.145036    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:00.145164 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.145144    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:00.147877 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.147852    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sq7c7\""
Jul 06 23:00:00.148085 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.148070    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:00.152534 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.152511    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:00.155554 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.155527    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-ct57k"]
Jul 06 23:00:00.236471 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.236437    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d6sd\" (UniqueName: \"kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd\") pod \"maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr\" (UID: \"ce9ac770-eff0-44cc-be5a-6ddc8c52b140\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:00.236635 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.236478    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4ds\" (UniqueName: \"kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds\") pod \"maas-api-key-cleanup-29722980-ct57k\" (UID: \"a29ae314-bacc-4a71-b059-5f0711e914fb\") " pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:00.337557 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.337521    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d6sd\" (UniqueName: \"kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd\") pod \"maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr\" (UID: \"ce9ac770-eff0-44cc-be5a-6ddc8c52b140\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:00.337716 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.337564    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4ds\" (UniqueName: \"kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds\") pod \"maas-api-key-cleanup-29722980-ct57k\" (UID: \"a29ae314-bacc-4a71-b059-5f0711e914fb\") " pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:00.346987 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.346954    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4ds\" (UniqueName: \"kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds\") pod \"maas-api-key-cleanup-29722980-ct57k\" (UID: \"a29ae314-bacc-4a71-b059-5f0711e914fb\") " pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:00.347092 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.346954    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d6sd\" (UniqueName: \"kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd\") pod \"maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr\" (UID: \"ce9ac770-eff0-44cc-be5a-6ddc8c52b140\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:00.458935 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.458828    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:00.464874 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.464854    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:00.601743 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.601568    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-ct57k"]
Jul 06 23:00:00.605669 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:00:00.605637    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29ae314_bacc_4a71_b059_5f0711e914fb.slice/crio-d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc WatchSource:0}: Error finding container d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc: Status 404 returned error can't find the container with id d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc
Jul 06 23:00:00.607951 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.607931    2589 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:00:00.621050 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:00.621030    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:00.623014 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:00:00.622979    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9ac770_eff0_44cc_be5a_6ddc8c52b140.slice/crio-f28e99baaecfaac43bf77987a6f1bd0fb1cf24d94397a5528597f96faf595433 WatchSource:0}: Error finding container f28e99baaecfaac43bf77987a6f1bd0fb1cf24d94397a5528597f96faf595433: Status 404 returned error can't find the container with id f28e99baaecfaac43bf77987a6f1bd0fb1cf24d94397a5528597f96faf595433
Jul 06 23:00:01.166876 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:01.166830    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr" event={"ID":"ce9ac770-eff0-44cc-be5a-6ddc8c52b140","Type":"ContainerStarted","Data":"f28e99baaecfaac43bf77987a6f1bd0fb1cf24d94397a5528597f96faf595433"}
Jul 06 23:00:01.168060 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:01.168033    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k" event={"ID":"a29ae314-bacc-4a71-b059-5f0711e914fb","Type":"ContainerStarted","Data":"d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc"}
Jul 06 23:00:06.195789 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:06.195754    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr" event={"ID":"ce9ac770-eff0-44cc-be5a-6ddc8c52b140","Type":"ContainerStarted","Data":"c500735fccb3cefb5256e4d1ab217ee2c4db7cc6090e58a892d1691e9cb58bfe"}
Jul 06 23:00:06.211485 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:06.211438    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr" podStartSLOduration=1.5121749420000001 podStartE2EDuration="6.211421594s" totalImagesPullingTime="4.699246652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:06.210930742 +0000 UTC m=+1988.018677812" watchObservedRunningTime="2026-07-06 23:00:06.211421594 +0000 UTC m=+1988.019168661"
Jul 06 23:00:07.162668 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:07.162632    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:07.201608 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:07.201575    2589 generic.go:356] "Generic (PLEG): container finished" podID="ce9ac770-eff0-44cc-be5a-6ddc8c52b140" containerID="c500735fccb3cefb5256e4d1ab217ee2c4db7cc6090e58a892d1691e9cb58bfe" exitCode=0
Jul 06 23:00:07.201985 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:07.201647    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr" event={"ID":"ce9ac770-eff0-44cc-be5a-6ddc8c52b140","Type":"ContainerDied","Data":"c500735fccb3cefb5256e4d1ab217ee2c4db7cc6090e58a892d1691e9cb58bfe"}
Jul 06 23:00:08.332026 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:08.332001    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:08.407876 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:08.407842    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d6sd\" (UniqueName: \"kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd\") pod \"ce9ac770-eff0-44cc-be5a-6ddc8c52b140\" (UID: \"ce9ac770-eff0-44cc-be5a-6ddc8c52b140\") "
Jul 06 23:00:08.410024 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:08.409996    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd" (OuterVolumeSpecName: "kube-api-access-8d6sd") pod "ce9ac770-eff0-44cc-be5a-6ddc8c52b140" (UID: "ce9ac770-eff0-44cc-be5a-6ddc8c52b140"). InnerVolumeSpecName "kube-api-access-8d6sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:00:08.508660 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:08.508577    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d6sd\" (UniqueName: \"kubernetes.io/projected/ce9ac770-eff0-44cc-be5a-6ddc8c52b140-kube-api-access-8d6sd\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:00:09.212477 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.212447    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"
Jul 06 23:00:09.212677 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.212445    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr" event={"ID":"ce9ac770-eff0-44cc-be5a-6ddc8c52b140","Type":"ContainerDied","Data":"f28e99baaecfaac43bf77987a6f1bd0fb1cf24d94397a5528597f96faf595433"}
Jul 06 23:00:09.212677 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.212594    2589 scope.go:117] "RemoveContainer" containerID="c500735fccb3cefb5256e4d1ab217ee2c4db7cc6090e58a892d1691e9cb58bfe"
Jul 06 23:00:09.229152 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.229127    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:09.230989 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.230967    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-63da37-29722980-2gqwr"]
Jul 06 23:00:09.989732 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:09.989694    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:00:10.687127 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:10.687093    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9ac770-eff0-44cc-be5a-6ddc8c52b140" path="/var/lib/kubelet/pods/ce9ac770-eff0-44cc-be5a-6ddc8c52b140/volumes"
Jul 06 23:00:22.116131 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:22.116097    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:00:23.280048 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:23.280015    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k" event={"ID":"a29ae314-bacc-4a71-b059-5f0711e914fb","Type":"ContainerStarted","Data":"a1b68c6d7b98a0e3cc37b16e055e8b28b0772719c7f51ccdcaf6a7be7540bcf0"}
Jul 06 23:00:23.294400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:23.294249    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k" podStartSLOduration=1.312080816 podStartE2EDuration="23.294230366s" totalImagesPullingTime="21.98214955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:23.293873077 +0000 UTC m=+2005.101620143" watchObservedRunningTime="2026-07-06 23:00:23.294230366 +0000 UTC m=+2005.101977433"
Jul 06 23:00:24.286341 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:24.286308    2589 generic.go:356] "Generic (PLEG): container finished" podID="a29ae314-bacc-4a71-b059-5f0711e914fb" containerID="a1b68c6d7b98a0e3cc37b16e055e8b28b0772719c7f51ccdcaf6a7be7540bcf0" exitCode=0
Jul 06 23:00:24.286745 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:24.286400    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k" event={"ID":"a29ae314-bacc-4a71-b059-5f0711e914fb","Type":"ContainerDied","Data":"a1b68c6d7b98a0e3cc37b16e055e8b28b0772719c7f51ccdcaf6a7be7540bcf0"}
Jul 06 23:00:25.419364 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:25.419336    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:25.555642 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:25.555530    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch4ds\" (UniqueName: \"kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds\") pod \"a29ae314-bacc-4a71-b059-5f0711e914fb\" (UID: \"a29ae314-bacc-4a71-b059-5f0711e914fb\") "
Jul 06 23:00:25.557688 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:25.557664    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds" (OuterVolumeSpecName: "kube-api-access-ch4ds") pod "a29ae314-bacc-4a71-b059-5f0711e914fb" (UID: "a29ae314-bacc-4a71-b059-5f0711e914fb"). InnerVolumeSpecName "kube-api-access-ch4ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:00:25.656599 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:25.656567    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch4ds\" (UniqueName: \"kubernetes.io/projected/a29ae314-bacc-4a71-b059-5f0711e914fb-kube-api-access-ch4ds\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:00:26.298381 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:26.298349    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k" event={"ID":"a29ae314-bacc-4a71-b059-5f0711e914fb","Type":"ContainerDied","Data":"d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc"}
Jul 06 23:00:26.298381 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:26.298368    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-ct57k"
Jul 06 23:00:26.298588 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:26.298399    2589 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8d5cee32118796688e42784579c2d54c888902026c24e28eff9af9e0bc4ecbc"
Jul 06 23:00:34.495746 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:34.495703    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:00:47.784654 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:00:47.784617    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:01:02.293499 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:02.293450    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:01:13.307567 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:13.307529    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:01:23.906281 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906202    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906514    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9ac770-eff0-44cc-be5a-6ddc8c52b140" containerName="cleanup"
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906525    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9ac770-eff0-44cc-be5a-6ddc8c52b140" containerName="cleanup"
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906536    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29ae314-bacc-4a71-b059-5f0711e914fb" containerName="cleanup"
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906542    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29ae314-bacc-4a71-b059-5f0711e914fb" containerName="cleanup"
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906602    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9ac770-eff0-44cc-be5a-6ddc8c52b140" containerName="cleanup"
Jul 06 23:01:23.906632 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.906609    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29ae314-bacc-4a71-b059-5f0711e914fb" containerName="cleanup"
Jul 06 23:01:23.909735 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.909715    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:23.912734 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.912710    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"kube-root-ca.crt\""
Jul 06 23:01:23.913908 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.913888    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"openshift-service-ca.crt\""
Jul 06 23:01:23.914019 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.913907    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"auth-test-model-2ea5e8-kserve-self-signed-certs\""
Jul 06 23:01:23.914019 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.913890    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"default-dockercfg-xl5lc\""
Jul 06 23:01:23.922067 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:23.922045    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:01:24.051162 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051120    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.051347 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051177    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.051347 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051253    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.051347 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051280    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.051347 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051322    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.051347 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.051341    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrm6\" (UniqueName: \"kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152014 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.151975    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152014 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152015    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152263 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152059    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152263 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152083    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrm6\" (UniqueName: \"kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152263 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152118    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152263 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152175    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152538 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152504    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152719 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152547    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.152836 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.152591    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.154356 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.154330    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.154626 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.154609    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.160050 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.160002    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrm6\" (UniqueName: \"kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6\") pod \"auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") " pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.218538 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.218500    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:24.350006 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.349981    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:01:24.351481 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:01:24.351448    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a522a51_017e_4c4e_b81a_8347f9ad0c4c.slice/crio-3afb13a29e59d21da16c5e4414c88a444abb0b5850d6607a9b81be4dd229d962 WatchSource:0}: Error finding container 3afb13a29e59d21da16c5e4414c88a444abb0b5850d6607a9b81be4dd229d962: Status 404 returned error can't find the container with id 3afb13a29e59d21da16c5e4414c88a444abb0b5850d6607a9b81be4dd229d962
Jul 06 23:01:24.584017 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.583982    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" event={"ID":"4a522a51-017e-4c4e-b81a-8347f9ad0c4c","Type":"ContainerStarted","Data":"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"}
Jul 06 23:01:24.584017 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.584022    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" event={"ID":"4a522a51-017e-4c4e-b81a-8347f9ad0c4c","Type":"ContainerStarted","Data":"3afb13a29e59d21da16c5e4414c88a444abb0b5850d6607a9b81be4dd229d962"}
Jul 06 23:01:24.601308 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:24.601264    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" podStartSLOduration=1.6012487530000001 podStartE2EDuration="1.601248753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:01:24.599876996 +0000 UTC m=+2066.407624061" watchObservedRunningTime="2026-07-06 23:01:24.601248753 +0000 UTC m=+2066.408995818"
Jul 06 23:01:27.487081 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:27.487043    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:01:34.218939 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:34.218904    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:34.219315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:34.218954    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:34.232112 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:34.232092    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:34.642793 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:34.642763    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:01:54.693393 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.693360    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:01:54.696666 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.696648    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.700486 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.700470    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"openshift-service-ca.crt\""
Jul 06 23:01:54.700486 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.700475    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"kube-root-ca.crt\""
Jul 06 23:01:54.700658 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.700487    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"default-dockercfg-q7p4t\""
Jul 06 23:01:54.700658 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.700478    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"auth-test-model-2de350-kserve-self-signed-certs\""
Jul 06 23:01:54.706758 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.706740    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:01:54.801189 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801145    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.801189 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801189    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.801419 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801210    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.801419 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801311    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4v4\" (UniqueName: \"kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.801419 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801348    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.801419 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.801369    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.901928 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.901876    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4v4\" (UniqueName: \"kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902116 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.901942    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902116 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.901978    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902116 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902082    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902116 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902113    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902322 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902149    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902621 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902593    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902766 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902627    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.902766 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.902638    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.904636 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.904614    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.904745 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.904703    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:54.909605 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:54.909583    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4v4\" (UniqueName: \"kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4\") pod \"auth-test-model-2de350-kserve-76d54ff75-hlqsg\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") " pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:55.007022 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:55.006931    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:01:55.161445 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:55.161298    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:01:55.163611 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:01:55.163581    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod266b42e3_f303_4005_ab0a_48f81e8d6aa0.slice/crio-c4778000a34e7129be6f229c1dc5eff543b3e4440fdbee195b4d7d323389af72 WatchSource:0}: Error finding container c4778000a34e7129be6f229c1dc5eff543b3e4440fdbee195b4d7d323389af72: Status 404 returned error can't find the container with id c4778000a34e7129be6f229c1dc5eff543b3e4440fdbee195b4d7d323389af72
Jul 06 23:01:55.739185 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:55.739149    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" event={"ID":"266b42e3-f303-4005-ab0a-48f81e8d6aa0","Type":"ContainerStarted","Data":"4e5f3e5351ea3205afe382c96068b21482a7d2915eb17f13a3534b5da7a3d1e0"}
Jul 06 23:01:55.739185 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:55.739192    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" event={"ID":"266b42e3-f303-4005-ab0a-48f81e8d6aa0","Type":"ContainerStarted","Data":"c4778000a34e7129be6f229c1dc5eff543b3e4440fdbee195b4d7d323389af72"}
Jul 06 23:01:55.756823 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:55.756763    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" podStartSLOduration=1.756748312 podStartE2EDuration="1.756748312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:01:55.754927985 +0000 UTC m=+2097.562675051" watchObservedRunningTime="2026-07-06 23:01:55.756748312 +0000 UTC m=+2097.564495378"
Jul 06 23:01:58.090691 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:58.090653    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:01:58.828377 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:58.828347    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 23:01:58.830167 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:01:58.830148    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 23:02:05.007345 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:05.007310    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:02:05.007755 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:05.007364    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:02:05.019919 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:05.019891    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:02:05.799707 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:05.799674    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:02:16.287443 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:16.287405    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:02:31.300500 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:31.300461    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:02:47.988852 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:02:47.988818    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:03:04.100803 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:04.100719    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:03:20.082646 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:20.082607    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:03:36.689215 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:36.689184    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:03:48.242981 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:48.242946    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:03:49.179736 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:49.179698    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:03:50.997210 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:03:50.997177    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:04:03.262893 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.262853    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" podUID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" containerName="main" containerID="cri-o://d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee" gracePeriod=45
Jul 06 23:04:03.518060 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.518003    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:04:03.647177 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647141    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647213    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647255    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647283    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhrm6\" (UniqueName: \"kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647306    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647325    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm\") pod \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\" (UID: \"4a522a51-017e-4c4e-b81a-8347f9ad0c4c\") "
Jul 06 23:04:03.647644 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647453    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:03.647644 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647526    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home" (OuterVolumeSpecName: "home") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:03.647644 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647547    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:03.647644 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.647561    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:03.649529 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.649504    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm" (OuterVolumeSpecName: "dshm") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:03.649640 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.649564    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6" (OuterVolumeSpecName: "kube-api-access-bhrm6") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "kube-api-access-bhrm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:04:03.649640 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.649590    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a522a51-017e-4c4e-b81a-8347f9ad0c4c" (UID: "4a522a51-017e-4c4e-b81a-8347f9ad0c4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:04:03.748279 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.748241    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:03.748279 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.748270    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:03.748279 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.748280    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhrm6\" (UniqueName: \"kubernetes.io/projected/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-kube-api-access-bhrm6\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:03.748279 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.748289    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:03.748552 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:03.748297    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a522a51-017e-4c4e-b81a-8347f9ad0c4c-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.199624 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.199586    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" podUID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" containerName="main" containerID="cri-o://4e5f3e5351ea3205afe382c96068b21482a7d2915eb17f13a3534b5da7a3d1e0" gracePeriod=45
Jul 06 23:04:04.380779 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.380747    2589 generic.go:356] "Generic (PLEG): container finished" podID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" containerID="d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee" exitCode=0
Jul 06 23:04:04.381212 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.380788    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"
Jul 06 23:04:04.381212 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.380841    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" event={"ID":"4a522a51-017e-4c4e-b81a-8347f9ad0c4c","Type":"ContainerDied","Data":"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"}
Jul 06 23:04:04.381212 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.380895    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx" event={"ID":"4a522a51-017e-4c4e-b81a-8347f9ad0c4c","Type":"ContainerDied","Data":"3afb13a29e59d21da16c5e4414c88a444abb0b5850d6607a9b81be4dd229d962"}
Jul 06 23:04:04.381212 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.380922    2589 scope.go:117] "RemoveContainer" containerID="d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"
Jul 06 23:04:04.382719 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.382696    2589 generic.go:356] "Generic (PLEG): container finished" podID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" containerID="4e5f3e5351ea3205afe382c96068b21482a7d2915eb17f13a3534b5da7a3d1e0" exitCode=0
Jul 06 23:04:04.382850 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.382735    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" event={"ID":"266b42e3-f303-4005-ab0a-48f81e8d6aa0","Type":"ContainerDied","Data":"4e5f3e5351ea3205afe382c96068b21482a7d2915eb17f13a3534b5da7a3d1e0"}
Jul 06 23:04:04.393122 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.393097    2589 scope.go:117] "RemoveContainer" containerID="d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"
Jul 06 23:04:04.393409 ip-10-0-135-240 kubenswrapper[2589]: E0706 23:04:04.393388    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee\": container with ID starting with d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee not found: ID does not exist" containerID="d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"
Jul 06 23:04:04.393493 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.393416    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee"} err="failed to get container status \"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee\": rpc error: code = NotFound desc = could not find container \"d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee\": container with ID starting with d7b7b8a2aa99bc575b16724087db60de63abe54606044abea147e4032fcb5fee not found: ID does not exist"
Jul 06 23:04:04.405904 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.405878    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:04:04.409378 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.409356    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/auth-test-model-2ea5e8-kserve-5956f8d99f-7v9dx"]
Jul 06 23:04:04.454890 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.454772    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:04:04.555060 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555030    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g4v4\" (UniqueName: \"kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555060 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555065    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555299 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555117    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555299 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555145    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555299 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555209    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555299 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555242    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs\") pod \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\" (UID: \"266b42e3-f303-4005-ab0a-48f81e8d6aa0\") "
Jul 06 23:04:04.555509 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555379    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache" (OuterVolumeSpecName: "model-cache") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:04.555509 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555390    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:04.555612 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555535    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.555612 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555550    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.555612 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.555553    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home" (OuterVolumeSpecName: "home") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:04.557470 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.557436    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm" (OuterVolumeSpecName: "dshm") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:04:04.557592 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.557521    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4" (OuterVolumeSpecName: "kube-api-access-5g4v4") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "kube-api-access-5g4v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:04:04.557592 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.557552    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "266b42e3-f303-4005-ab0a-48f81e8d6aa0" (UID: "266b42e3-f303-4005-ab0a-48f81e8d6aa0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:04:04.656269 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.656220    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266b42e3-f303-4005-ab0a-48f81e8d6aa0-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.656269 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.656262    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g4v4\" (UniqueName: \"kubernetes.io/projected/266b42e3-f303-4005-ab0a-48f81e8d6aa0-kube-api-access-5g4v4\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.656269 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.656273    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.656269 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.656284    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266b42e3-f303-4005-ab0a-48f81e8d6aa0-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:04:04.686827 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:04.686777    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" path="/var/lib/kubelet/pods/4a522a51-017e-4c4e-b81a-8347f9ad0c4c/volumes"
Jul 06 23:04:05.183014 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.182978    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:04:05.389423 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.389391    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"
Jul 06 23:04:05.389920 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.389420    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg" event={"ID":"266b42e3-f303-4005-ab0a-48f81e8d6aa0","Type":"ContainerDied","Data":"c4778000a34e7129be6f229c1dc5eff543b3e4440fdbee195b4d7d323389af72"}
Jul 06 23:04:05.389920 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.389480    2589 scope.go:117] "RemoveContainer" containerID="4e5f3e5351ea3205afe382c96068b21482a7d2915eb17f13a3534b5da7a3d1e0"
Jul 06 23:04:05.405907 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.405883    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:04:05.409756 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.409735    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/auth-test-model-2de350-kserve-76d54ff75-hlqsg"]
Jul 06 23:04:05.595693 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.595656    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:04:05.595991 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.595977    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" containerName="main"
Jul 06 23:04:05.596037 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.595994    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" containerName="main"
Jul 06 23:04:05.596037 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.596016    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" containerName="main"
Jul 06 23:04:05.596037 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.596021    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" containerName="main"
Jul 06 23:04:05.596137 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.596071    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" containerName="main"
Jul 06 23:04:05.596137 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.596081    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a522a51-017e-4c4e-b81a-8347f9ad0c4c" containerName="main"
Jul 06 23:04:05.600196 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.600179    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.602793 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.602771    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"openshift-service-ca.crt\""
Jul 06 23:04:05.602929 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.602773    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"kube-root-ca.crt\""
Jul 06 23:04:05.603001 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.602906    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"sub-test-model-2ea5e8-kserve-self-signed-certs\""
Jul 06 23:04:05.603076 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.603036    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"default-dockercfg-xl5lc\""
Jul 06 23:04:05.611487 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.611462    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:04:05.766508 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766466    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.766508 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766510    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mj8\" (UniqueName: \"kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.766727 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766551    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.766727 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766595    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.766727 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766655    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.766727 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.766702    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.867943 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.867858    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.867943 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.867915    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.867943 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.867947    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868188 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.867983    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868188 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.868002    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mj8\" (UniqueName: \"kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868188 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.868130    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868346 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.868286    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868346 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.868324    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.868453 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.868417    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.870316 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.870295    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.870474 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.870454    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.875364 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.875340    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mj8\" (UniqueName: \"kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8\") pod \"sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") " pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:05.909893 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:05.909868    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:06.038479 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:06.038451    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:04:06.040218 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:04:06.040185    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e3a4efb_a5c2_4a0b_9141_77ae7fecf15d.slice/crio-f47c41d3cd3ab917d55ffffe722af8123dcf492f4d57d483a83522520871e0a8 WatchSource:0}: Error finding container f47c41d3cd3ab917d55ffffe722af8123dcf492f4d57d483a83522520871e0a8: Status 404 returned error can't find the container with id f47c41d3cd3ab917d55ffffe722af8123dcf492f4d57d483a83522520871e0a8
Jul 06 23:04:06.397055 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:06.397016    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" event={"ID":"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d","Type":"ContainerStarted","Data":"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"}
Jul 06 23:04:06.397508 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:06.397068    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" event={"ID":"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d","Type":"ContainerStarted","Data":"f47c41d3cd3ab917d55ffffe722af8123dcf492f4d57d483a83522520871e0a8"}
Jul 06 23:04:06.415309 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:06.415246    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" podStartSLOduration=1.415232603 podStartE2EDuration="1.415232603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:04:06.412596048 +0000 UTC m=+2228.220343115" watchObservedRunningTime="2026-07-06 23:04:06.415232603 +0000 UTC m=+2228.222979647"
Jul 06 23:04:06.687387 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:06.687309    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="266b42e3-f303-4005-ab0a-48f81e8d6aa0" path="/var/lib/kubelet/pods/266b42e3-f303-4005-ab0a-48f81e8d6aa0/volumes"
Jul 06 23:04:15.910150 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:15.910112    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:15.910683 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:15.910369    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:15.923108 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:15.923085    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:16.092983 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:16.092948    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:04:16.458134 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:16.458102    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:04:38.091422 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.091342    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:04:38.094638 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.094620    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.098461 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.098440    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"sub-test-model-2de350-kserve-self-signed-certs\""
Jul 06 23:04:38.098620 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.098473    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"default-dockercfg-q7p4t\""
Jul 06 23:04:38.098620 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.098530    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"openshift-service-ca.crt\""
Jul 06 23:04:38.098620 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.098582    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"kube-root-ca.crt\""
Jul 06 23:04:38.106523 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.106503    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:04:38.226493 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226455    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.226673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226507    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.226673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226526    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.226673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226542    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.226673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226580    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.226673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.226636    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w44h\" (UniqueName: \"kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327229 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327191    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327245    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327265    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327381    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327554 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327411    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327554 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327433    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w44h\" (UniqueName: \"kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327666 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327620    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327724 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327661    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.327852 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.327835    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.329597 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.329577    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.329756 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.329737    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.335501 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.335477    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w44h\" (UniqueName: \"kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h\") pod \"sub-test-model-2de350-kserve-67674bd78f-wrfbf\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") " pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.405248 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.405156    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:38.535010 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.534987    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:04:38.536784 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:04:38.536756    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25513b4_e54d_495b_931d_6ce8f8e98547.slice/crio-e172ae6fdad2979d6190aea11be277b831b7ae6b692a7680cb01aab8a6a111d1 WatchSource:0}: Error finding container e172ae6fdad2979d6190aea11be277b831b7ae6b692a7680cb01aab8a6a111d1: Status 404 returned error can't find the container with id e172ae6fdad2979d6190aea11be277b831b7ae6b692a7680cb01aab8a6a111d1
Jul 06 23:04:38.559007 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:38.558983    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" event={"ID":"b25513b4-e54d-495b-931d-6ce8f8e98547","Type":"ContainerStarted","Data":"e172ae6fdad2979d6190aea11be277b831b7ae6b692a7680cb01aab8a6a111d1"}
Jul 06 23:04:39.565414 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:39.565375    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" event={"ID":"b25513b4-e54d-495b-931d-6ce8f8e98547","Type":"ContainerStarted","Data":"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"}
Jul 06 23:04:39.583664 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:39.583607    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" podStartSLOduration=1.583593459 podStartE2EDuration="1.583593459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:04:39.582095723 +0000 UTC m=+2261.389842801" watchObservedRunningTime="2026-07-06 23:04:39.583593459 +0000 UTC m=+2261.391340524"
Jul 06 23:04:42.491101 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:42.491066    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:04:48.405647 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:48.405606    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:48.406191 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:48.405661    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:48.418563 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:48.418537    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:48.621663 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:48.621627    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:04:56.691387 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:04:56.691353    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:05:12.979035 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:12.979000    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:05:13.878584 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:13.878547    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:05:17.295018 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:17.294982    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:05:24.592925 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.592888    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:05:24.596336 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.596318    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.598824 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.598794    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2ea5e8\"/\"rate-test-model-2ea5e8-kserve-self-signed-certs\""
Jul 06 23:05:24.605728 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.605705    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:05:24.608410 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608389    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.608518 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608422    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.608518 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608445    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.608518 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608498    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.608679 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608535    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pt68\" (UniqueName: \"kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.608679 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.608605    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.708940 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.708912    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.708940 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.708945    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709259 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.708965    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pt68\" (UniqueName: \"kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709259 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.708993    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709259 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.709053    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709259 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.709079    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.709693    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.709711    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.709938 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.709775    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.711382 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.711364    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.711706 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.711688    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.716946 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.716925    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pt68\" (UniqueName: \"kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68\") pod \"rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") " pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:24.906261 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:24.906166    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:25.037073 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:25.037047    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:05:25.038938 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:05:25.038911    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fe912df_8a5e_4b10_93b2_2b76cfbab10b.slice/crio-6d4f867a529e668ee658bbb9010e15bead1d6c39695f43b238603d1cbeec9cec WatchSource:0}: Error finding container 6d4f867a529e668ee658bbb9010e15bead1d6c39695f43b238603d1cbeec9cec: Status 404 returned error can't find the container with id 6d4f867a529e668ee658bbb9010e15bead1d6c39695f43b238603d1cbeec9cec
Jul 06 23:05:25.797206 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:25.797166    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" event={"ID":"7fe912df-8a5e-4b10-93b2-2b76cfbab10b","Type":"ContainerStarted","Data":"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"}
Jul 06 23:05:25.797206 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:25.797207    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" event={"ID":"7fe912df-8a5e-4b10-93b2-2b76cfbab10b","Type":"ContainerStarted","Data":"6d4f867a529e668ee658bbb9010e15bead1d6c39695f43b238603d1cbeec9cec"}
Jul 06 23:05:25.812554 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:25.812506    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" podStartSLOduration=1.81249266 podStartE2EDuration="1.81249266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:05:25.811720393 +0000 UTC m=+2307.619467470" watchObservedRunningTime="2026-07-06 23:05:25.81249266 +0000 UTC m=+2307.620239726"
Jul 06 23:05:27.998823 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:27.998730    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" podUID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" containerName="main" containerID="cri-o://97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63" gracePeriod=45
Jul 06 23:05:28.244068 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.244045    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:05:28.338114 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338073    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338123    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338163    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338208    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8mj8\" (UniqueName: \"kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338231    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338266    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir\") pod \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\" (UID: \"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d\") "
Jul 06 23:05:28.338607 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338370    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home" (OuterVolumeSpecName: "home") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:28.338607 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338532    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.338607 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338546    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:28.338607 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.338556    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:28.340376 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.340351    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:05:28.340376 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.340371    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm" (OuterVolumeSpecName: "dshm") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:28.340528 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.340428    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8" (OuterVolumeSpecName: "kube-api-access-d8mj8") pod "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" (UID: "1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d"). InnerVolumeSpecName "kube-api-access-d8mj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:05:28.439785 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.439746    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8mj8\" (UniqueName: \"kubernetes.io/projected/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-kube-api-access-d8mj8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.439785 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.439780    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.439785 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.439791    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.440054 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.439799    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.440054 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.439825    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:28.814196 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.814152    2589 generic.go:356] "Generic (PLEG): container finished" podID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" containerID="97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63" exitCode=0
Jul 06 23:05:28.814371 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.814201    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"
Jul 06 23:05:28.814371 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.814237    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" event={"ID":"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d","Type":"ContainerDied","Data":"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"}
Jul 06 23:05:28.814371 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.814282    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c" event={"ID":"1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d","Type":"ContainerDied","Data":"f47c41d3cd3ab917d55ffffe722af8123dcf492f4d57d483a83522520871e0a8"}
Jul 06 23:05:28.814371 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.814299    2589 scope.go:117] "RemoveContainer" containerID="97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"
Jul 06 23:05:28.822847 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.822802    2589 scope.go:117] "RemoveContainer" containerID="97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"
Jul 06 23:05:28.823099 ip-10-0-135-240 kubenswrapper[2589]: E0706 23:05:28.823076    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63\": container with ID starting with 97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63 not found: ID does not exist" containerID="97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"
Jul 06 23:05:28.823176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.823100    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63"} err="failed to get container status \"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63\": rpc error: code = NotFound desc = could not find container \"97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63\": container with ID starting with 97adce8d9575d105980d9fc7d616b59c061622ddea8e36f66b43cf2dbbd0cc63 not found: ID does not exist"
Jul 06 23:05:28.830994 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.830974    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:05:28.836590 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.836569    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/sub-test-model-2ea5e8-kserve-797b4ff6b7-bs52c"]
Jul 06 23:05:28.899053 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:28.899013    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" podUID="b25513b4-e54d-495b-931d-6ce8f8e98547" containerName="main" containerID="cri-o://c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e" gracePeriod=45
Jul 06 23:05:29.150997 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.150969    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:05:29.246558 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246522    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.246558 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246563    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.246847 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246602    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.246847 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246632    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.246847 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246649    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w44h\" (UniqueName: \"kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.246847 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246678    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home\") pod \"b25513b4-e54d-495b-931d-6ce8f8e98547\" (UID: \"b25513b4-e54d-495b-931d-6ce8f8e98547\") "
Jul 06 23:05:29.247080 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246967    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache" (OuterVolumeSpecName: "model-cache") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:29.247080 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.246991    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:29.247080 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.247032    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home" (OuterVolumeSpecName: "home") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:29.248743 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.248716    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:05:29.248868 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.248750    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm" (OuterVolumeSpecName: "dshm") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:05:29.248868 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.248757    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h" (OuterVolumeSpecName: "kube-api-access-9w44h") pod "b25513b4-e54d-495b-931d-6ce8f8e98547" (UID: "b25513b4-e54d-495b-931d-6ce8f8e98547"). InnerVolumeSpecName "kube-api-access-9w44h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:05:29.347319 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347281    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25513b4-e54d-495b-931d-6ce8f8e98547-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.347319 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347311    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.347319 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347324    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w44h\" (UniqueName: \"kubernetes.io/projected/b25513b4-e54d-495b-931d-6ce8f8e98547-kube-api-access-9w44h\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.347570 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347335    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.347570 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347347    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.347570 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.347357    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25513b4-e54d-495b-931d-6ce8f8e98547-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:05:29.819641 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.819609    2589 generic.go:356] "Generic (PLEG): container finished" podID="b25513b4-e54d-495b-931d-6ce8f8e98547" containerID="c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e" exitCode=0
Jul 06 23:05:29.819843 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.819651    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"
Jul 06 23:05:29.819843 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.819693    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" event={"ID":"b25513b4-e54d-495b-931d-6ce8f8e98547","Type":"ContainerDied","Data":"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"}
Jul 06 23:05:29.819843 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.819732    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf" event={"ID":"b25513b4-e54d-495b-931d-6ce8f8e98547","Type":"ContainerDied","Data":"e172ae6fdad2979d6190aea11be277b831b7ae6b692a7680cb01aab8a6a111d1"}
Jul 06 23:05:29.819843 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.819753    2589 scope.go:117] "RemoveContainer" containerID="c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"
Jul 06 23:05:29.828594 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.828577    2589 scope.go:117] "RemoveContainer" containerID="c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"
Jul 06 23:05:29.828841 ip-10-0-135-240 kubenswrapper[2589]: E0706 23:05:29.828820    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e\": container with ID starting with c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e not found: ID does not exist" containerID="c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"
Jul 06 23:05:29.828897 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.828847    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e"} err="failed to get container status \"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e\": rpc error: code = NotFound desc = could not find container \"c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e\": container with ID starting with c50a017e14d956c8bc849b062f0110ad82b0f4b7debb506c12a6666ad8ca4b3e not found: ID does not exist"
Jul 06 23:05:29.840786 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.840762    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:05:29.844398 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:29.844379    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/sub-test-model-2de350-kserve-67674bd78f-wrfbf"]
Jul 06 23:05:30.688581 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:30.688546    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" path="/var/lib/kubelet/pods/1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d/volumes"
Jul 06 23:05:30.688959 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:30.688931    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25513b4-e54d-495b-931d-6ce8f8e98547" path="/var/lib/kubelet/pods/b25513b4-e54d-495b-931d-6ce8f8e98547/volumes"
Jul 06 23:05:31.388257 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:31.388213    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:05:34.906971 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:34.906936    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:34.907394 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:34.907013    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:34.919902 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:34.919880    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:35.864699 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:35.864668    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:05:42.729149 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729117    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:05:42.729547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729429    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" containerName="main"
Jul 06 23:05:42.729547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729440    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" containerName="main"
Jul 06 23:05:42.729547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729464    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25513b4-e54d-495b-931d-6ce8f8e98547" containerName="main"
Jul 06 23:05:42.729547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729479    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25513b4-e54d-495b-931d-6ce8f8e98547" containerName="main"
Jul 06 23:05:42.729547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729540    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25513b4-e54d-495b-931d-6ce8f8e98547" containerName="main"
Jul 06 23:05:42.729711 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.729551    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3a4efb-a5c2-4a0b-9141-77ae7fecf15d" containerName="main"
Jul 06 23:05:42.732458 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.732442    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.739400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.739378    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"rate-test-model-2de350-kserve-self-signed-certs\""
Jul 06 23:05:42.739400 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.739391    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"default-dockercfg-q7p4t\""
Jul 06 23:05:42.739949 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.739934    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"openshift-service-ca.crt\""
Jul 06 23:05:42.741140 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.741126    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2de350\"/\"kube-root-ca.crt\""
Jul 06 23:05:42.755393 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.755363    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:05:42.864518 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864483    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.864518 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864519    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.864722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864545    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.864722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864626    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4sqg\" (UniqueName: \"kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.864722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864685    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.864722 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.864719    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966158 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966119    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966356 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966186    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966356 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966219    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966356 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966256    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966517 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966379    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4sqg\" (UniqueName: \"kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966517 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966448    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966628 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966607    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966715 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966693    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.966772 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.966739    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.968517 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.968497    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.968789 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.968771    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:42.974604 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:42.974582    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4sqg\" (UniqueName: \"kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg\") pod \"rate-test-model-2de350-kserve-55f9846b7f-j8skp\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") " pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:43.041399 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:43.041357    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:43.172736 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:43.172708    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:05:43.174647 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:05:43.174614    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfffa498a_3766_4f64_8c7e_d9e61ee2d2d5.slice/crio-1281f82fd4832e1f2d50c73362c64bc98f5975647f7c9c62b3911695c8a85d2f WatchSource:0}: Error finding container 1281f82fd4832e1f2d50c73362c64bc98f5975647f7c9c62b3911695c8a85d2f: Status 404 returned error can't find the container with id 1281f82fd4832e1f2d50c73362c64bc98f5975647f7c9c62b3911695c8a85d2f
Jul 06 23:05:43.891692 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:43.891653    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" event={"ID":"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5","Type":"ContainerStarted","Data":"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"}
Jul 06 23:05:43.891692 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:43.891700    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" event={"ID":"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5","Type":"ContainerStarted","Data":"1281f82fd4832e1f2d50c73362c64bc98f5975647f7c9c62b3911695c8a85d2f"}
Jul 06 23:05:43.929772 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:43.929711    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" podStartSLOduration=1.929691308 podStartE2EDuration="1.929691308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:05:43.927669676 +0000 UTC m=+2325.735416741" watchObservedRunningTime="2026-07-06 23:05:43.929691308 +0000 UTC m=+2325.737438357"
Jul 06 23:05:47.992132 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:47.992090    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:05:53.042547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:53.042459    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:53.042961 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:53.042655    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:53.055215 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:53.055187    2589 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:05:53.952724 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:05:53.952696    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:06:29.085392 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:29.085355    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:06:42.093125 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:42.093082    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:06:48.637999 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:48.637962    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:06:49.577182 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:49.577145    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:06:54.793101 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:54.793061    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:06:58.863186 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:58.863157    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 23:06:58.866064 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:06:58.866009    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnbhg_86fc918c-2782-495d-9d6e-463c59f88b50/ovn-acl-logging/0.log"
Jul 06 23:07:03.658436 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.658368    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" podUID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" containerName="main" containerID="cri-o://dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0" gracePeriod=45
Jul 06 23:07:03.908398 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.908372    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:07:03.996115 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996035    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pt68\" (UniqueName: \"kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996115 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996083    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996153    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996315 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996187    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996412 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996362    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996412 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996397    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:03.996412 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996407    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm\") pod \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\" (UID: \"7fe912df-8a5e-4b10-93b2-2b76cfbab10b\") "
Jul 06 23:07:03.996533 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996414    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home" (OuterVolumeSpecName: "home") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:03.996628 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996598    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:03.996707 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996662    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:03.996707 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.996682    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:03.998270 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.998240    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68" (OuterVolumeSpecName: "kube-api-access-2pt68") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "kube-api-access-2pt68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:07:03.998375 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.998273    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:07:03.998375 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:03.998339    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm" (OuterVolumeSpecName: "dshm") pod "7fe912df-8a5e-4b10-93b2-2b76cfbab10b" (UID: "7fe912df-8a5e-4b10-93b2-2b76cfbab10b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:04.097682 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.097648    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:04.097682 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.097680    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:04.097682 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.097691    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pt68\" (UniqueName: \"kubernetes.io/projected/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-kube-api-access-2pt68\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:04.097682 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.097700    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fe912df-8a5e-4b10-93b2-2b76cfbab10b-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:04.291947 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.291915    2589 generic.go:356] "Generic (PLEG): container finished" podID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" containerID="dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0" exitCode=0
Jul 06 23:07:04.292121 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.291958    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"
Jul 06 23:07:04.292121 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.291986    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" event={"ID":"7fe912df-8a5e-4b10-93b2-2b76cfbab10b","Type":"ContainerDied","Data":"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"}
Jul 06 23:07:04.292121 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.292017    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k" event={"ID":"7fe912df-8a5e-4b10-93b2-2b76cfbab10b","Type":"ContainerDied","Data":"6d4f867a529e668ee658bbb9010e15bead1d6c39695f43b238603d1cbeec9cec"}
Jul 06 23:07:04.292121 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.292033    2589 scope.go:117] "RemoveContainer" containerID="dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"
Jul 06 23:07:04.301917 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.301884    2589 scope.go:117] "RemoveContainer" containerID="dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"
Jul 06 23:07:04.302164 ip-10-0-135-240 kubenswrapper[2589]: E0706 23:07:04.302141    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0\": container with ID starting with dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0 not found: ID does not exist" containerID="dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"
Jul 06 23:07:04.302238 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.302176    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0"} err="failed to get container status \"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0\": rpc error: code = NotFound desc = could not find container \"dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0\": container with ID starting with dee4abd9ea68407d0c177a7242efbdc88251c7e2fc0606cb05ca38b0516b72e0 not found: ID does not exist"
Jul 06 23:07:04.315203 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.315178    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:07:04.318466 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.318444    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2ea5e8/rate-test-model-2ea5e8-kserve-6fcdc6955f-b9x5k"]
Jul 06 23:07:04.597111 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.597014    2589 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" podUID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" containerName="main" containerID="cri-o://d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4" gracePeriod=45
Jul 06 23:07:04.687673 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.687643    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" path="/var/lib/kubelet/pods/7fe912df-8a5e-4b10-93b2-2b76cfbab10b/volumes"
Jul 06 23:07:04.838291 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.838266    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:07:04.905732 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905662    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.905732 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905707    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.905979 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905740    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4sqg\" (UniqueName: \"kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.905979 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905757    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.905979 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905832    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.905979 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905855    2589 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm\") pod \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\" (UID: \"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5\") "
Jul 06 23:07:04.906182 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.905960    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:04.906182 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.906039    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:04.906288 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.906211    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home" (OuterVolumeSpecName: "home") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:04.907948 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.907920    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg" (OuterVolumeSpecName: "kube-api-access-t4sqg") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "kube-api-access-t4sqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:07:04.907948 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.907945    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm" (OuterVolumeSpecName: "dshm") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:07:04.908088 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:04.907927    2589 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" (UID: "fffa498a-3766-4f64-8c7e-d9e61ee2d2d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:07:05.006693 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006660    2589 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.006693 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006688    2589 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4sqg\" (UniqueName: \"kubernetes.io/projected/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-kube-api-access-t4sqg\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.006693 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006699    2589 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.006963 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006708    2589 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.006963 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006717    2589 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.006963 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.006725    2589 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Jul 06 23:07:05.297594 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.297564    2589 generic.go:356] "Generic (PLEG): container finished" podID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" containerID="d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4" exitCode=0
Jul 06 23:07:05.297765 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.297607    2589 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"
Jul 06 23:07:05.297765 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.297660    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" event={"ID":"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5","Type":"ContainerDied","Data":"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"}
Jul 06 23:07:05.297765 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.297698    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp" event={"ID":"fffa498a-3766-4f64-8c7e-d9e61ee2d2d5","Type":"ContainerDied","Data":"1281f82fd4832e1f2d50c73362c64bc98f5975647f7c9c62b3911695c8a85d2f"}
Jul 06 23:07:05.297765 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.297719    2589 scope.go:117] "RemoveContainer" containerID="d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"
Jul 06 23:07:05.307095 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.307080    2589 scope.go:117] "RemoveContainer" containerID="d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"
Jul 06 23:07:05.307346 ip-10-0-135-240 kubenswrapper[2589]: E0706 23:07:05.307330    2589 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4\": container with ID starting with d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4 not found: ID does not exist" containerID="d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"
Jul 06 23:07:05.307396 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.307354    2589 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4"} err="failed to get container status \"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4\": rpc error: code = NotFound desc = could not find container \"d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4\": container with ID starting with d39845cf49f7862813d84f9b9954869c2d2f89cc47e56d655cd402646e3776a4 not found: ID does not exist"
Jul 06 23:07:05.319710 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.319691    2589 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:07:05.322882 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:05.322862    2589 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2de350/rate-test-model-2de350-kserve-55f9846b7f-j8skp"]
Jul 06 23:07:06.687195 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:06.687161    2589 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" path="/var/lib/kubelet/pods/fffa498a-3766-4f64-8c7e-d9e61ee2d2d5/volumes"
Jul 06 23:07:37.687230 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:37.687150    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7ntfw"]
Jul 06 23:07:41.132087 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:41.132050    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759b74bccc-qtxk2_6815bc7e-2ba8-4805-b2f7-70d3dc8aed61/authorino/0.log"
Jul 06 23:07:46.221938 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:46.221906    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-ct57k_a29ae314-bacc-4a71-b059-5f0711e914fb/cleanup/0.log"
Jul 06 23:07:46.573740 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:46.573711    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x74lk_5cfe4904-6e09-42cf-9db2-148973907030/manager/0.log"
Jul 06 23:07:46.691375 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:46.691347    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-cqpll_68a54b17-7520-4139-8b94-077190f1fa9c/copy-manifests/0.log"
Jul 06 23:07:46.698144 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:46.698128    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-cqpll_68a54b17-7520-4139-8b94-077190f1fa9c/manager/0.log"
Jul 06 23:07:47.850587 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.850555    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/util/0.log"
Jul 06 23:07:47.856881 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.856861    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/pull/0.log"
Jul 06 23:07:47.863151 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.863135    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/extract/0.log"
Jul 06 23:07:47.975508 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.975467    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/util/0.log"
Jul 06 23:07:47.981772 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.981750    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/pull/0.log"
Jul 06 23:07:47.987614 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:47.987596    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/extract/0.log"
Jul 06 23:07:48.100641 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.100576    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/pull/0.log"
Jul 06 23:07:48.107376 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.107358    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/extract/0.log"
Jul 06 23:07:48.113930 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.113909    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/util/0.log"
Jul 06 23:07:48.228475 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.228447    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/util/0.log"
Jul 06 23:07:48.235667 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.235645    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/pull/0.log"
Jul 06 23:07:48.242288 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.242272    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/extract/0.log"
Jul 06 23:07:48.359685 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.359611    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759b74bccc-qtxk2_6815bc7e-2ba8-4805-b2f7-70d3dc8aed61/authorino/0.log"
Jul 06 23:07:48.708332 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:48.708248    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs26t_e3719a3d-b9d1-40fd-956b-b7a3723a0fb6/kuadrant-console-plugin/0.log"
Jul 06 23:07:49.072311 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:49.072282    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7ntfw_12465b51-a3b9-4d94-a196-0b606bfc2759/limitador/0.log"
Jul 06 23:07:49.794392 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:49.794362    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-4sbrl_3ad3652d-bb0a-4252-a75c-c6bb1f8af914/kube-auth-proxy/0.log"
Jul 06 23:07:50.375035 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:50.375008    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f8c84d9f-hc9zh_b1383232-1de0-4f53-b63f-4dfb4d42dd96/router/0.log"
Jul 06 23:07:51.298482 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:51.298458    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fdd24_0af06060-f5d7-44dc-bd8a-98e979668856/main/0.log"
Jul 06 23:07:55.159703 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.159666    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjzlh/must-gather-99gzq"]
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160003    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" containerName="main"
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160014    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" containerName="main"
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160025    2589 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" containerName="main"
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160030    2589 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" containerName="main"
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160089    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffa498a-3766-4f64-8c7e-d9e61ee2d2d5" containerName="main"
Jul 06 23:07:55.160176 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.160099    2589 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fe912df-8a5e-4b10-93b2-2b76cfbab10b" containerName="main"
Jul 06 23:07:55.163118 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.163097    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.165750 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.165726    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjzlh\"/\"kube-root-ca.crt\""
Jul 06 23:07:55.166760 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.166744    2589 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjzlh\"/\"default-dockercfg-dmwst\""
Jul 06 23:07:55.166827 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.166744    2589 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjzlh\"/\"openshift-service-ca.crt\""
Jul 06 23:07:55.173331 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.173312    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/must-gather-99gzq"]
Jul 06 23:07:55.238217 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.238180    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-must-gather-output\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.238217 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.238219    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8j9\" (UniqueName: \"kubernetes.io/projected/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-kube-api-access-wf8j9\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.339488 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.339444    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-must-gather-output\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.339488 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.339488    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8j9\" (UniqueName: \"kubernetes.io/projected/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-kube-api-access-wf8j9\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.339834 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.339790    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-must-gather-output\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.347786 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.347753    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8j9\" (UniqueName: \"kubernetes.io/projected/1d13e4a5-7cda-4770-9de6-4dec63fbe2f9-kube-api-access-wf8j9\") pod \"must-gather-99gzq\" (UID: \"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9\") " pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.473200 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.473120    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/must-gather-99gzq"
Jul 06 23:07:55.606307 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.606280    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/must-gather-99gzq"]
Jul 06 23:07:55.608437 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:07:55.608409    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d13e4a5_7cda_4770_9de6_4dec63fbe2f9.slice/crio-ae5cf8e16057463f85f2d35c80e939de27fb3b33cabb3808e1b2d68cbb87af96 WatchSource:0}: Error finding container ae5cf8e16057463f85f2d35c80e939de27fb3b33cabb3808e1b2d68cbb87af96: Status 404 returned error can't find the container with id ae5cf8e16057463f85f2d35c80e939de27fb3b33cabb3808e1b2d68cbb87af96
Jul 06 23:07:55.610461 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:55.610442    2589 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:07:56.556547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:56.556449    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/must-gather-99gzq" event={"ID":"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9","Type":"ContainerStarted","Data":"554631069f600d70d3bc36d5583be24855d4b72c61d9896bb8b1b1679a8a69a1"}
Jul 06 23:07:56.556547 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:56.556519    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/must-gather-99gzq" event={"ID":"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9","Type":"ContainerStarted","Data":"ae5cf8e16057463f85f2d35c80e939de27fb3b33cabb3808e1b2d68cbb87af96"}
Jul 06 23:07:57.565703 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:57.565662    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/must-gather-99gzq" event={"ID":"1d13e4a5-7cda-4770-9de6-4dec63fbe2f9","Type":"ContainerStarted","Data":"510a9e83fba6c2887a0d3fdca412f18c103c8787c429336b046a753573a0da76"}
Jul 06 23:07:57.582750 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:57.582699    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjzlh/must-gather-99gzq" podStartSLOduration=1.795645977 podStartE2EDuration="2.582680935s" totalImagesPullingTime="787.034958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:07:57.580903017 +0000 UTC m=+2459.388650083" watchObservedRunningTime="2026-07-06 23:07:57.582680935 +0000 UTC m=+2459.390428001"
Jul 06 23:07:58.045799 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:58.045757    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tljfq_6f71a1ac-fa08-4e66-8cc4-74e402b99619/global-pull-secret-syncer/0.log"
Jul 06 23:07:58.157555 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:58.157524    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfjnj_f5467990-b657-4b27-8e5a-0b3ef3404c8a/konnectivity-agent/0.log"
Jul 06 23:07:58.200960 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:07:58.200927    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-240.ec2.internal_3b12c154aed0715acfb2aca1c887480a/haproxy/0.log"
Jul 06 23:08:02.866297 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.866255    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/extract/0.log"
Jul 06 23:08:02.891409 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.891378    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/util/0.log"
Jul 06 23:08:02.917146 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.917111    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lt9dc_3f2d389c-e65f-4479-966b-5a7f22a925a5/pull/0.log"
Jul 06 23:08:02.947670 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.947625    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/extract/0.log"
Jul 06 23:08:02.970499 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.970464    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/util/0.log"
Jul 06 23:08:02.996452 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:02.996417    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fgt7h_87cef8cf-9df8-4d66-81ab-508b993d5622/pull/0.log"
Jul 06 23:08:03.026455 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.026429    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/extract/0.log"
Jul 06 23:08:03.052965 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.052938    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/util/0.log"
Jul 06 23:08:03.098653 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.096100    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jnq2j_70bc6dcc-09d1-438a-93d0-c4473fdb619d/pull/0.log"
Jul 06 23:08:03.129041 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.128958    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/extract/0.log"
Jul 06 23:08:03.148264 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.148184    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/util/0.log"
Jul 06 23:08:03.170618 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.170580    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkcjg_b7a398a4-3033-46c9-856b-a5f2155c8949/pull/0.log"
Jul 06 23:08:03.511453 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.511321    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759b74bccc-qtxk2_6815bc7e-2ba8-4805-b2f7-70d3dc8aed61/authorino/0.log"
Jul 06 23:08:03.595271 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.595231    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs26t_e3719a3d-b9d1-40fd-956b-b7a3723a0fb6/kuadrant-console-plugin/0.log"
Jul 06 23:08:03.793060 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:03.793031    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7ntfw_12465b51-a3b9-4d94-a196-0b606bfc2759/limitador/0.log"
Jul 06 23:08:05.657496 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:05.657454    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-gl6tj_e7fe07aa-0892-406a-b47d-07084117c770/cluster-monitoring-operator/0.log"
Jul 06 23:08:05.832359 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:05.832253    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cstd_22913f42-9365-4902-aa87-5361c8937690/node-exporter/0.log"
Jul 06 23:08:05.855272 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:05.855242    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cstd_22913f42-9365-4902-aa87-5361c8937690/kube-rbac-proxy/0.log"
Jul 06 23:08:05.889947 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:05.889908    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cstd_22913f42-9365-4902-aa87-5361c8937690/init-textfile/0.log"
Jul 06 23:08:06.391322 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:06.391293    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-b5rnv_6aa5f4db-b816-4b13-9270-4d52a8e092d7/prometheus-operator-admission-webhook/0.log"
Jul 06 23:08:07.764630 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:07.764597    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-8gjmr_9eab8910-1710-4af5-9d9a-4beaad7c03eb/networking-console-plugin/0.log"
Jul 06 23:08:08.192890 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.192854    2589 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"]
Jul 06 23:08:08.201013 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.200983    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.205993 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.205968    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"]
Jul 06 23:08:08.271041 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.270995    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-lib-modules\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.271383 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.271362    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdx4n\" (UniqueName: \"kubernetes.io/projected/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-kube-api-access-hdx4n\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.271544 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.271528    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-proc\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.271669 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.271656    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-podres\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.271792 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.271779    2589 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-sys\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.372587 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.372547    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdx4n\" (UniqueName: \"kubernetes.io/projected/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-kube-api-access-hdx4n\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.372873 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.372849    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-proc\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373025 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373009    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-podres\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373160 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373144    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-sys\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373301 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373158    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-podres\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373374 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373031    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-proc\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373374 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373217    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-sys\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373616 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373595    2589 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-lib-modules\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.373965 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.373838    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-lib-modules\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.381384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.381354    2589 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdx4n\" (UniqueName: \"kubernetes.io/projected/2e62adf0-ec4c-4b62-a367-fa6bd968f5b9-kube-api-access-hdx4n\") pod \"perf-node-gather-daemonset-zgctf\" (UID: \"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.520464 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.520369    2589 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:08.678713 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.678684    2589 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"]
Jul 06 23:08:08.680230 ip-10-0-135-240 kubenswrapper[2589]: W0706 23:08:08.680188    2589 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e62adf0_ec4c_4b62_a367_fa6bd968f5b9.slice/crio-9180b3dcf2db360e4039481532a35c42ddb449fd235d14d358e3fd43f3a75ed5 WatchSource:0}: Error finding container 9180b3dcf2db360e4039481532a35c42ddb449fd235d14d358e3fd43f3a75ed5: Status 404 returned error can't find the container with id 9180b3dcf2db360e4039481532a35c42ddb449fd235d14d358e3fd43f3a75ed5
Jul 06 23:08:08.906403 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:08.906305    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fc995648d-4jfb4_8198f59c-718c-4520-a2cb-a24ace2b806f/console/0.log"
Jul 06 23:08:09.656194 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:09.656152    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf" event={"ID":"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9","Type":"ContainerStarted","Data":"c10db819ad5917bc94764b7338e4675760c92ad0f159c56143484d2dcb1ee4cf"}
Jul 06 23:08:09.656377 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:09.656220    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:09.656377 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:09.656237    2589 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf" event={"ID":"2e62adf0-ec4c-4b62-a367-fa6bd968f5b9","Type":"ContainerStarted","Data":"9180b3dcf2db360e4039481532a35c42ddb449fd235d14d358e3fd43f3a75ed5"}
Jul 06 23:08:09.672384 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:09.672336    2589 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf" podStartSLOduration=1.672320719 podStartE2EDuration="1.672320719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:08:09.670996885 +0000 UTC m=+2471.478743951" watchObservedRunningTime="2026-07-06 23:08:09.672320719 +0000 UTC m=+2471.480067784"
Jul 06 23:08:10.590119 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:10.590075    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9k4c_8142f9a7-01b0-4927-aa2b-bf431091a0c5/dns/0.log"
Jul 06 23:08:10.611005 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:10.610976    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9k4c_8142f9a7-01b0-4927-aa2b-bf431091a0c5/kube-rbac-proxy/0.log"
Jul 06 23:08:10.680153 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:10.680122    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xf8ms_951bc210-4e3a-4d52-b73f-b6e5b0da6a78/dns-node-resolver/0.log"
Jul 06 23:08:11.204209 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:11.204182    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwh7w_bd54723d-9285-4271-a148-3dede3060239/node-ca/0.log"
Jul 06 23:08:12.367627 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:12.367601    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-4sbrl_3ad3652d-bb0a-4252-a75c-c6bb1f8af914/kube-auth-proxy/0.log"
Jul 06 23:08:12.548819 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:12.548767    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f8c84d9f-hc9zh_b1383232-1de0-4f53-b63f-4dfb4d42dd96/router/0.log"
Jul 06 23:08:13.233536 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.233504    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5k28_db83e1fc-3963-4eb0-80ae-e9ccd2a18711/serve-healthcheck-canary/0.log"
Jul 06 23:08:13.740417 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.740363    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-59czs_ba34b5c3-179e-4410-b409-c746e410653f/insights-operator/0.log"
Jul 06 23:08:13.740868 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.740598    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-59czs_ba34b5c3-179e-4410-b409-c746e410653f/insights-operator/1.log"
Jul 06 23:08:13.762920 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.762776    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk86v_1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea/kube-rbac-proxy/0.log"
Jul 06 23:08:13.784926 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.784901    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk86v_1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea/exporter/0.log"
Jul 06 23:08:13.805582 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:13.805557    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk86v_1dfe7d4d-f04e-4647-a8e2-65bbc1bc85ea/extractor/0.log"
Jul 06 23:08:15.671515 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:15.671479    2589 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-zgctf"
Jul 06 23:08:16.285431 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:16.285402    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-ct57k_a29ae314-bacc-4a71-b059-5f0711e914fb/cleanup/0.log"
Jul 06 23:08:16.482828 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:16.482786    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x74lk_5cfe4904-6e09-42cf-9db2-148973907030/manager/0.log"
Jul 06 23:08:16.512241 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:16.512205    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-cqpll_68a54b17-7520-4139-8b94-077190f1fa9c/manager/0.log"
Jul 06 23:08:16.533577 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:16.533539    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-cqpll_68a54b17-7520-4139-8b94-077190f1fa9c/copy-manifests/0.log"
Jul 06 23:08:18.197469 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:18.197421    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c7f89b564-kln9r_5d0af2d4-a0b3-4e2c-9366-01cf23935c1d/manager/0.log"
Jul 06 23:08:18.222523 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:18.222475    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zscrr_2ee6683f-da92-42a5-a1db-68758384181d/openshift-lws-operator/0.log"
Jul 06 23:08:18.452526 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:18.452445    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-4sbrl_3ad3652d-bb0a-4252-a75c-c6bb1f8af914/kube-auth-proxy/0.log"
Jul 06 23:08:18.588658 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:18.588615    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f8c84d9f-hc9zh_b1383232-1de0-4f53-b63f-4dfb4d42dd96/router/0.log"
Jul 06 23:08:19.937706 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:19.937670    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-4sbrl_3ad3652d-bb0a-4252-a75c-c6bb1f8af914/kube-auth-proxy/0.log"
Jul 06 23:08:20.082890 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:20.082855    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f8c84d9f-hc9zh_b1383232-1de0-4f53-b63f-4dfb4d42dd96/router/0.log"
Jul 06 23:08:24.706717 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.706690    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/kube-multus-additional-cni-plugins/0.log"
Jul 06 23:08:24.728590 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.728564    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/egress-router-binary-copy/0.log"
Jul 06 23:08:24.750047 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.750019    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/cni-plugins/0.log"
Jul 06 23:08:24.770243 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.770220    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/bond-cni-plugin/0.log"
Jul 06 23:08:24.791471 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.791442    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/routeoverride-cni/0.log"
Jul 06 23:08:24.811556 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.811532    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/whereabouts-cni-bincopy/0.log"
Jul 06 23:08:24.831425 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.831405    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shmn7_1aeacd19-3d2f-48f1-b02e-fbf9c1769bf1/whereabouts-cni/0.log"
Jul 06 23:08:24.917718 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.917691    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qtl2d_af30a7bb-d175-49e6-b131-9c61eb165f6b/kube-multus/0.log"
Jul 06 23:08:24.979906 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:24.979832    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d76mt_0066e2d4-dea7-4dc7-91df-9722a09761d1/network-metrics-daemon/0.log"
Jul 06 23:08:25.001095 ip-10-0-135-240 kubenswrapper[2589]: I0706 23:08:25.001071    2589 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d76mt_0066e2d4-dea7-4dc7-91df-9722a09761d1/kube-rbac-proxy/0.log"