Jul 15 21:04:15.483011 ip-10-0-129-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 21:04:15.483022 ip-10-0-129-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 21:04:15.483030 ip-10-0-129-60 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 21:04:15.483251 ip-10-0-129-60 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 21:04:24.965686 ip-10-0-129-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 21:04:24.965705 ip-10-0-129-60 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4fb642f43d104929a3bb2d1edec4c23f --
Jul 15 21:06:19.140731 ip-10-0-129-60 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.642967    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648440    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648455    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648461    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648465    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648470    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648475    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648487    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.715136 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648492    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648497    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648501    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648506    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648510    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648514    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648518    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648522    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648526    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648531    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648535    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648539    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648544    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648548    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648553    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648557    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648561    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648565    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648569    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648573    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.717180 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648577    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648581    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648585    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648589    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648593    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648597    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648601    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648605    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648608    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648614    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648621    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648627    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648633    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648638    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648642    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648648    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648652    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648657    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648661    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.717868 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648667    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648671    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648676    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648680    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648687    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648692    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648697    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648701    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648706    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648711    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648715    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648719    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648724    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648728    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648732    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648735    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648739    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648743    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648747    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648751    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.718771 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648755    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648759    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648765    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648770    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648774    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648778    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648782    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648787    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648791    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648795    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648800    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648804    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648808    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648812    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648819    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648823    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648827    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648830    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648834    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648838    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.719672 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648843    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648847    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648851    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648855    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648859    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648868    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648872    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648877    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648880    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648884    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648888    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648892    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.648896    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649943    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649951    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649955    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649960    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649965    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649970    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.720827 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649975    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649979    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649983    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649987    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649992    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.649996    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650001    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650005    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650009    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650013    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650017    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650020    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650024    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650028    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650032    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650036    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650040    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650044    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650047    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650052    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.721504 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650056    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650060    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650064    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650069    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650075    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650080    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650085    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650089    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650093    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650097    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650101    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650105    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650109    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650118    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650123    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650132    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650136    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650140    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650143    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.722653 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650150    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650154    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650159    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650163    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650168    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650173    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650177    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650181    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650185    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650189    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650193    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650197    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650202    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650206    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650210    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650214    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650218    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650222    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650226    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650231    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.723543 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650235    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650239    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650243    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650247    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650251    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650255    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650259    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650264    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650268    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650273    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650278    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650282    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650287    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650290    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650295    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650298    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650302    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650307    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650310    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650315    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.724580 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650319    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650330    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650334    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650338    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650343    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650347    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650351    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650355    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650378    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650383    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650389    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650394    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650398    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650404    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650978    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650986    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650991    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650995    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.650999    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.725650 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651004    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651009    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651013    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651018    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651024    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651029    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651034    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651038    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651042    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651046    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651050    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651054    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651058    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651062    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651068    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651073    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651077    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651083    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651088    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651092    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.726839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651095    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651099    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651103    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651109    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651116    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651122    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651126    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651131    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651134    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651138    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651142    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651146    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651150    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651154    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651159    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651163    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651167    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651171    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651175    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651179    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.727567 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651183    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651186    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651190    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651194    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651197    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651201    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651207    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651211    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651215    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651219    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651223    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651226    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651230    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651235    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651238    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651244    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651248    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651252    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651257    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.728907 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651261    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651264    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651268    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651272    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651276    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651280    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651284    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651289    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651292    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651296    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651302    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651305    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651309    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651313    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651317    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651321    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651324    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651328    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651332    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651338    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.729619 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651342    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651346    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651350    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651354    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651384    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651389    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651393    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651397    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651403    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651407    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651411    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651415    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651419    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651423    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.651429    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651542    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651552    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651561    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651568    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651575    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651581    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 21:06:19.730755 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651587    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651594    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651599    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651604    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651609    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651614    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651619    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651624    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651630    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651634    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651641    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651646    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651653    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651658    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651664    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651668    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651674    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651680    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651685    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651691    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651696    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651701    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651706    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651711    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 21:06:19.731473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651717    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651722    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651728    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651733    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651738    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651742    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651747    2581 flags.go:64] FLAG: --enable-server="true"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651752    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651759    2581 flags.go:64] FLAG: --event-burst="100"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651765    2581 flags.go:64] FLAG: --event-qps="50"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651769    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651774    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651778    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651785    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651790    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651794    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651799    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651804    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651810    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651815    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651820    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651825    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651829    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651834    2581 flags.go:64] FLAG: --feature-gates=""
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651840    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 21:06:19.732161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651845    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651850    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651857    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651861    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651866    2581 flags.go:64] FLAG: --help="false"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651871    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651876    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651881    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651886    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651895    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651900    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651905    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651910    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651914    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651919    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651925    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651931    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651936    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651941    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651945    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651950    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651954    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651959    2581 flags.go:64] FLAG: --lock-file=""
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651964    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 21:06:19.733061 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651969    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651975    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651985    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651990    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.651995    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652000    2581 flags.go:64] FLAG: --logging-format="text"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652005    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652011    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652015    2581 flags.go:64] FLAG: --manifest-url=""
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652020    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652028    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652033    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652039    2581 flags.go:64] FLAG: --max-pods="110"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652045    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652050    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652055    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652060    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652065    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652070    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652074    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652086    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652091    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652096    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 21:06:19.734006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652100    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652105    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652114    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652119    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652124    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652129    2581 flags.go:64] FLAG: --port="10250"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652133    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652138    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b931a64bd2c670f2"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652144    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652149    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652155    2581 flags.go:64] FLAG: --register-node="true"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652160    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652165    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652170    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652175    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652180    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652186    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652191    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652196    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652200    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652207    2581 flags.go:64] FLAG: --runonce="false"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652212    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652217    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652221    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652226    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 21:06:19.734901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652231    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652236    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652240    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652245    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652250    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652255    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652259    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652264    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652268    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652273    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652279    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652287    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652292    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652296    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652303    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652307    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652312    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652319    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652324    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652329    2581 flags.go:64] FLAG: --v="2"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652335    2581 flags.go:64] FLAG: --version="false"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652342    2581 flags.go:64] FLAG: --vmodule=""
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652348    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.652353    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 21:06:19.735807 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652580    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652588    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652592    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652599    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652604    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652608    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652613    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652618    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652625    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652631    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652636    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652641    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652646    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652650    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652654    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652658    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652662    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652666    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652673    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.736989 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652679    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652682    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652686    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652691    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652695    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652699    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652705    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652709    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652713    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652717    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652721    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652725    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652729    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652733    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652752    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652756    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652763    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652768    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652772    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652776    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.739106 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652780    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652784    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652788    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652792    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652797    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652801    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652805    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652809    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652813    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652817    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652821    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652825    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652829    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652834    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652837    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652841    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652845    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652849    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652855    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652859    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.739921 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652863    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652867    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652871    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652875    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652879    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652883    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652887    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652891    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652897    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652902    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652906    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652910    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652914    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652918    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652922    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652926    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652932    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652938    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652943    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652947    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.740540 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652951    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652955    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652959    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652963    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652967    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652971    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652976    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652981    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652986    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652992    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.652998    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653002    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653006    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653011    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653014    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653018    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653023    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653026    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653031    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.741176 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.653035    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.653044    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.662154    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.662172    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.663312    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.663325    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663399    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663405    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663409    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663413    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663416    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663420    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663424    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663427    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663429    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.741753 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663432    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663435    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663441    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663444    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663447    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663449    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663452    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663455    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663458    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663461    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663463    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663466    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663473    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663476    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663479    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663481    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663484    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663487    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663490    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663492    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.742224 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663495    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663498    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663501    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663504    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663507    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663510    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663513    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663515    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663518    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663521    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663523    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663526    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663529    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663532    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663537    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663539    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663542    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663546    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663549    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663552    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.743173 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663554    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663557    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663561    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663566    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663569    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663571    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663574    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663577    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663580    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663583    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663587    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663592    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663595    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663598    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663602    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663605    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663608    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663610    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663613    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.743875 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663616    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663618    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663621    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663624    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663626    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663629    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663632    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663636    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663639    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663642    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663645    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663649    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663652    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663655    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663657    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663660    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663663    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663666    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663668    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663671    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.744794 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663674    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663678    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663681    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663684    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663687    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663690    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663692    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663695    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663698    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663700    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663703    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.663709    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663826    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663832    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663835    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:06:19.745715 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663838    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663842    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663847    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663850    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663853    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663857    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663860    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663863    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663865    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663869    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663873    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663876    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663878    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663881    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663884    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663887    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663890    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663894    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663897    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663900    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:06:19.746649 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663903    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663906    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663909    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663911    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663914    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663917    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663919    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663922    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663925    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663927    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663930    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663932    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663935    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663938    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663942    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663944    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663947    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663951    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663954    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663957    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:06:19.747339 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663959    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663962    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663965    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663968    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663972    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663975    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663978    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663981    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663984    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663987    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663989    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663992    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663995    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.663997    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664000    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664002    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664005    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664007    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664010    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:06:19.748698 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664013    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664015    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664018    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664021    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664023    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664026    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664029    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664033    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664036    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664038    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664044    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664048    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664051    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664054    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664057    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664060    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664077    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664080    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664082    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:06:19.831829 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664085    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:06:19.749021 ip-10-0-129-60 systemd[1]: Started Kubernetes Kubelet.
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664088    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664091    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664093    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664096    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664099    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664101    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664104    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664107    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664110    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664112    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664115    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664118    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664121    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664124    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664126    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664129    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:06:19.832817 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:19.664132    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.664137    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.664257    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.666987    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.668856    2581 server.go:1019] "Starting client certificate rotation"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.668974    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.669018    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.671693    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.672889    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.686710    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.689115    2581 log.go:25] "Validated CRI v1 image API"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.690120    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 21:06:19.833731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.710674    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b67d437b-f034-4ac2-b3b7-fdc74efd8336:/dev/nvme0n1p3 fd13540d-9607-4417-bb3e-fc3a35da023e:/dev/nvme0n1p4]
Jul 15 21:06:19.835269 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.710696    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 21:06:19.835269 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.726064    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.727216    2581 manager.go:216] Machine: {Timestamp:2026-07-15 21:06:19.725590549 +0000 UTC m=+0.418496586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201191 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265b5cc1248cf11444758a3ddb0b54 SystemUUID:ec265b5c-c124-8cf1-1444-758a3ddb0b54 BootID:4fb642f4-3d10-4929-a3bb-2d1edec4c23f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:30:1d:ec:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:30:1d:ec:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:ba:3a:a5:76:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.727377    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.727493    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.728842    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.728873    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.729804    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.729817    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.729827    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.730740    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.732003    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.735961    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736104    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736142    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736156    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736175    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736188    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736201    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 21:06:19.835719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736669    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.736690    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.739605    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.741849    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.741879    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742655    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742680    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742690    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742699    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742719    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742731    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742764    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742778    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742790    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742800    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742823    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.742838    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.743837    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.743855    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.745574    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.745646    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.745730    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.747961    2581 server.go:1268] "Started kubelet"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.749171    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.751014    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.752075    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.752116    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.753591    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.759248    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.759258    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.759428    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760143    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760227    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760244    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760386    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760395    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760531    2581 factory.go:55] Registering systemd factory
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.760569    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.761615    2581 factory.go:153] Registering CRI-O factory
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.761629    2581 factory.go:223] Registration of the crio container factory successfully
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.761684    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.761713    2581 factory.go:103] Registering Raw factory
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.761727    2581 manager.go:1196] Started watching for new ooms in manager
Jul 15 21:06:19.836390 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.765517    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.759765    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-60.ec2.internal.18c292970709b63e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-60.ec2.internal,UID:ip-10-0-129-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-60.ec2.internal,},FirstTimestamp:2026-07-15 21:06:19.74793171 +0000 UTC m=+0.440837745,LastTimestamp:2026-07-15 21:06:19.74793171 +0000 UTC m=+0.440837745,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-60.ec2.internal,}"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.772071    2581 manager.go:349] Starting recovery of all containers
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.772138    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sh27k"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.774398    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.774457    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.783247    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sh27k"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.800050    2581 manager.go:354] Recovery completed
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.804666    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.806833    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.806862    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.806877    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.807531    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.807545    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.807552    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.807572    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.808320    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.808348    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.808374    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.808984    2581 policy_none.go:49] "None policy: Start"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.808997    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.809007    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.809575    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-60.ec2.internal.18c292970a8cb1bc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-60.ec2.internal,UID:ip-10-0-129-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-60.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-60.ec2.internal,},FirstTimestamp:2026-07-15 21:06:19.80684742 +0000 UTC m=+0.499753455,LastTimestamp:2026-07-15 21:06:19.80684742 +0000 UTC m=+0.499753455,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-60.ec2.internal,}"
Jul 15 21:06:19.837867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.810137    2581 policy_none.go:47] "Start"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.860484    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.879983    2581 manager.go:337] "Starting Device Plugin manager"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.880024    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880038    2581 server.go:87] "Starting device plugin registration server"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880375    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880388    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880576    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880679    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.880689    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.881260    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 21:06:19.966163 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.881319    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.981004    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.982012    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.982043    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.982054    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.982121    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.983789    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-60.ec2.internal\" not found" node="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.992411    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.992437    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-60.ec2.internal\": node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.993824    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.995461    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.995495    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.995517    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:19.995551    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:19.998111    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.034012    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.097198    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"]
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.097280    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.099055    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.099096    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.099106    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.100514    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.100656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.100686    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101241    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101270    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101280    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101370    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101396    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.101406    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.102559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.102583    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.103321    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.103349    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:06:20.127944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.103392    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.134459    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.139522    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-60.ec2.internal\" not found" node="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.147427    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-60.ec2.internal\" not found" node="ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.161750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.161773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.161792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f07e2ab30e2e8e91d0c170973cc72aa-config\") pod \"kube-apiserver-proxy-ip-10-0-129-60.ec2.internal\" (UID: \"5f07e2ab30e2e8e91d0c170973cc72aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.235412    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.262966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.263002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.263021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f07e2ab30e2e8e91d0c170973cc72aa-config\") pod \"kube-apiserver-proxy-ip-10-0-129-60.ec2.internal\" (UID: \"5f07e2ab30e2e8e91d0c170973cc72aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.263061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f07e2ab30e2e8e91d0c170973cc72aa-config\") pod \"kube-apiserver-proxy-ip-10-0-129-60.ec2.internal\" (UID: \"5f07e2ab30e2e8e91d0c170973cc72aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.263066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.302670 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.263083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec18b57cf91a11064c7551a2c57fb49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal\" (UID: \"fec18b57cf91a11064c7551a2c57fb49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.460043 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.340752    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.460043 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.443813    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.460043 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.443877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.460043 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.450421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.612075 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.544114    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.612075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.568426    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:20.645144 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.645114    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.667904 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.667872    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 21:06:20.668091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.668060    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 21:06:20.668091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.668060    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 21:06:20.745660 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:20.745591    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-60.ec2.internal\" not found"
Jul 15 21:06:20.790896 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.790866    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:20.807931 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.807894    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:01:20 +0000 UTC" deadline="2028-01-25 00:07:21.773818323 +0000 UTC"
Jul 15 21:06:20.807931 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.807931    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13395h1m0.965892146s"
Jul 15 21:06:20.823275 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.823255    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:20.860356 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.860333    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.879142 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.879122    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:06:20.880378 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.880361    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal"
Jul 15 21:06:20.890618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:20.890602    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:06:21.069035 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:21.069005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec18b57cf91a11064c7551a2c57fb49.slice/crio-7ff1b22f68b24d8caf0e8cefd829095913f5b4869388f6029bf8c209e5e3df4b WatchSource:0}: Error finding container 7ff1b22f68b24d8caf0e8cefd829095913f5b4869388f6029bf8c209e5e3df4b: Status 404 returned error can't find the container with id 7ff1b22f68b24d8caf0e8cefd829095913f5b4869388f6029bf8c209e5e3df4b
Jul 15 21:06:21.069809 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:21.069788    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f07e2ab30e2e8e91d0c170973cc72aa.slice/crio-0bb5d03ec83a15b15bf809ae79f0a4bc679ab3e00145cb0da9f5f81a7718eee6 WatchSource:0}: Error finding container 0bb5d03ec83a15b15bf809ae79f0a4bc679ab3e00145cb0da9f5f81a7718eee6: Status 404 returned error can't find the container with id 0bb5d03ec83a15b15bf809ae79f0a4bc679ab3e00145cb0da9f5f81a7718eee6
Jul 15 21:06:21.074869 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.074853    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:06:21.737623 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.737568    2581 apiserver.go:52] "Watching apiserver"
Jul 15 21:06:21.743281 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.743083    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 21:06:21.745599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.745562    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-t6sdk","openshift-network-operator/iptables-alerter-lv54z","kube-system/global-pull-secret-syncer-qv9r5","openshift-image-registry/node-ca-xtlrx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal","openshift-multus/multus-additional-cni-plugins-529zb","openshift-multus/network-metrics-daemon-zl9lr","openshift-ovn-kubernetes/ovnkube-node-2lmw6","kube-system/konnectivity-agent-zfhqz","kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w","openshift-cluster-node-tuning-operator/tuned-rmxsd","openshift-dns/node-resolver-zw2nw","openshift-multus/multus-5tzj2"]
Jul 15 21:06:21.747641 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.747445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.747641 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.747557    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:21.752775 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.752747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.753584 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.753549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.755241 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.755043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.755241 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.755215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.755421 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.755347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwwg6\""
Jul 15 21:06:21.756160 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.755904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 21:06:21.756160 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.755978    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 21:06:21.756160 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756004    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.756369 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 21:06:21.756429 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.756429 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.757165 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qfj9h\""
Jul 15 21:06:21.757165 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.756986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.757582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.757563    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 21:06:21.757690 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.757635    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.757690 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.757676    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lqgqh\""
Jul 15 21:06:21.757967 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.757949    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.759171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.758804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.759171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.759011    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.759171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.759042    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7z6xl\""
Jul 15 21:06:21.759171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.758805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.760357 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.760331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:21.760481 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.760414    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:21.760752 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.760735    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 21:06:21.760847 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.760774    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pl8bk\""
Jul 15 21:06:21.761038 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.761022    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 21:06:21.761105 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.761047    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 21:06:21.761773 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.761730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.764471 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.764447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-29sb8\""
Jul 15 21:06:21.765487 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.765462    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.767945 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.767850    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.769243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.768539    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-lib-modules\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvl5s\""
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-multus-certs\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpdc\" (UniqueName: \"kubernetes.io/projected/c11b51b4-df9b-4eb9-be85-7b6642653077-kube-api-access-twpdc\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-hostroot\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-modprobe-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-sys\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pw9c\" (UniqueName: \"kubernetes.io/projected/b878c29b-cb43-44bd-88e8-989972702c34-kube-api-access-2pw9c\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-cni-binary-copy\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-run\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-system-cni-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.772339 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpd7\" (UniqueName: \"kubernetes.io/projected/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kube-api-access-mmpd7\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-cnibin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-netns\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-multus\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771890    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-socket-dir-parent\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-os-release\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-kubernetes\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.771989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b878c29b-cb43-44bd-88e8-989972702c34-hosts-file\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b878c29b-cb43-44bd-88e8-989972702c34-tmp-dir\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-system-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d855b3-769d-428f-8ed8-d4c611187e0d-host\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d855b3-769d-428f-8ed8-d4c611187e0d-serviceca\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.773214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf27p\" (UniqueName: \"kubernetes.io/projected/57d855b3-769d-428f-8ed8-d4c611187e0d-kube-api-access-bf27p\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtr4f\" (UniqueName: \"kubernetes.io/projected/c72d1eb4-235f-4798-93a8-2a305dd3604f-kube-api-access-mtr4f\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-host\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87brg\" (UniqueName: \"kubernetes.io/projected/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-kube-api-access-87brg\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-daemon-config\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-conf\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-cnibin\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-k8s-cni-cncf-io\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-tuned\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2r8k\" (UniqueName: \"kubernetes.io/projected/4d49da64-81af-4a0e-9068-f30074a5f98e-kube-api-access-h2r8k\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-device-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-binary-copy\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-os-release\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.774116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-bin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysconfig\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-systemd\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-var-lib-kubelet\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-tmp\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-conf-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.772991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.773046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-etc-kubernetes\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.773084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-kubelet\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.773665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.774933    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-52kq7\""
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.774967    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 21:06:21.775003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.774984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 21:06:21.775723 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.775501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.775723 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.775564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:21.776309 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776284    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-djw8k\""
Jul 15 21:06:21.776440 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 21:06:21.776646 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776477    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 21:06:21.776646 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 21:06:21.776646 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776589    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 21:06:21.776831 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776737    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 21:06:21.776831 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.776739    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 21:06:21.777931 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.777765    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:06:21.799108 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.799085    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5js6w"
Jul 15 21:06:21.812207 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.812180    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5js6w"
Jul 15 21:06:21.861610 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.861581    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 21:06:21.873345 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysconfig\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysconfig\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-systemd\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-var-lib-kubelet\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873466    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-systemd\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-tmp\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-var-lib-kubelet\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-conf-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-etc-kubernetes\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ql6g\" (UniqueName: \"kubernetes.io/projected/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-kube-api-access-8ql6g\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-log-socket\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-kubelet-config\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-kubelet\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.873792 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc4394de-b0de-4efc-aa0b-693780465668-agent-certs\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-etc-kubernetes\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873814    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-kubelet\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-conf-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-lib-modules\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-multus-certs\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-netns\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.873982    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-lib-modules\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-multus-certs\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpdc\" (UniqueName: \"kubernetes.io/projected/c11b51b4-df9b-4eb9-be85-7b6642653077-kube-api-access-twpdc\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-hostroot\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-modprobe-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.874255 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-sys\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pw9c\" (UniqueName: \"kubernetes.io/projected/b878c29b-cb43-44bd-88e8-989972702c34-kube-api-access-2pw9c\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-hostroot\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-sys\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-modprobe-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-cni-binary-copy\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-kubelet\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-netd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-dbus\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-run\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-system-cni-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-run\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.875220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-system-cni-dir\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpd7\" (UniqueName: \"kubernetes.io/projected/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kube-api-access-mmpd7\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-cnibin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-netns\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-cnibin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-systemd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-netns\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxs5\" (UniqueName: \"kubernetes.io/projected/d77543a0-9337-4635-bfac-fa85c9be1cce-kube-api-access-krxs5\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-multus\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-ovn\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-socket-dir-parent\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.874977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-os-release\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-host-slash\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-bin\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875106    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-config\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-script-lib\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-kubernetes\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b878c29b-cb43-44bd-88e8-989972702c34-hosts-file\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b878c29b-cb43-44bd-88e8-989972702c34-tmp-dir\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-system-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d855b3-769d-428f-8ed8-d4c611187e0d-host\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d855b3-769d-428f-8ed8-d4c611187e0d-serviceca\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf27p\" (UniqueName: \"kubernetes.io/projected/57d855b3-769d-428f-8ed8-d4c611187e0d-kube-api-access-bf27p\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-iptables-alerter-script\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-var-lib-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtr4f\" (UniqueName: \"kubernetes.io/projected/c72d1eb4-235f-4798-93a8-2a305dd3604f-kube-api-access-mtr4f\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-host\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87brg\" (UniqueName: \"kubernetes.io/projected/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-kube-api-access-87brg\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.876912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-daemon-config\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-node-log\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-cni-binary-copy\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-env-overrides\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d77543a0-9337-4635-bfac-fa85c9be1cce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-system-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-conf\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-cnibin\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.875717    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b878c29b-cb43-44bd-88e8-989972702c34-tmp-dir\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-socket-dir-parent\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-cni-dir\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.875968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-os-release\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-kubernetes\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-d\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.877808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d855b3-769d-428f-8ed8-d4c611187e0d-host\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-multus\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d855b3-769d-428f-8ed8-d4c611187e0d-serviceca\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b878c29b-cb43-44bd-88e8-989972702c34-hosts-file\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d49da64-81af-4a0e-9068-f30074a5f98e-cnibin\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-host\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-sysctl-conf\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.876760    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:22.375782468 +0000 UTC m=+3.068688504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-k8s-cni-cncf-io\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc4394de-b0de-4efc-aa0b-693780465668-konnectivity-ca\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-tuned\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-run-k8s-cni-cncf-io\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.876988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2r8k\" (UniqueName: \"kubernetes.io/projected/4d49da64-81af-4a0e-9068-f30074a5f98e-kube-api-access-h2r8k\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-device-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.878758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-etc-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-binary-copy\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-os-release\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72d1eb4-235f-4798-93a8-2a305dd3604f-multus-daemon-config\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-bin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-systemd-units\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4751aaa3-2ea3-4a35-b4bc-939905964f0d-device-dir\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-slash\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-os-release\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.877423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72d1eb4-235f-4798-93a8-2a305dd3604f-host-var-lib-cni-bin\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.879582 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.878213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d49da64-81af-4a0e-9068-f30074a5f98e-cni-binary-copy\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.880137 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.879931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-tmp\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.883639 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.883560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-etc-tuned\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.886130 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.886102    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:21.886243 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.886140    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:21.886243 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.886155    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:21.886243 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.886235    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:22.386216541 +0000 UTC m=+3.079122563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:21.889393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.889347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpdc\" (UniqueName: \"kubernetes.io/projected/c11b51b4-df9b-4eb9-be85-7b6642653077-kube-api-access-twpdc\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:21.891958 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.891920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpd7\" (UniqueName: \"kubernetes.io/projected/4751aaa3-2ea3-4a35-b4bc-939905964f0d-kube-api-access-mmpd7\") pod \"aws-ebs-csi-driver-node-gpc8w\" (UID: \"4751aaa3-2ea3-4a35-b4bc-939905964f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:21.892561 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.892534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtr4f\" (UniqueName: \"kubernetes.io/projected/c72d1eb4-235f-4798-93a8-2a305dd3604f-kube-api-access-mtr4f\") pod \"multus-5tzj2\" (UID: \"c72d1eb4-235f-4798-93a8-2a305dd3604f\") " pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:21.893250 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.893226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf27p\" (UniqueName: \"kubernetes.io/projected/57d855b3-769d-428f-8ed8-d4c611187e0d-kube-api-access-bf27p\") pod \"node-ca-xtlrx\" (UID: \"57d855b3-769d-428f-8ed8-d4c611187e0d\") " pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:21.893343 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.893282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pw9c\" (UniqueName: \"kubernetes.io/projected/b878c29b-cb43-44bd-88e8-989972702c34-kube-api-access-2pw9c\") pod \"node-resolver-zw2nw\" (UID: \"b878c29b-cb43-44bd-88e8-989972702c34\") " pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:21.894173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.894149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87brg\" (UniqueName: \"kubernetes.io/projected/b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0-kube-api-access-87brg\") pod \"tuned-rmxsd\" (UID: \"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0\") " pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:21.894510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.894483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2r8k\" (UniqueName: \"kubernetes.io/projected/4d49da64-81af-4a0e-9068-f30074a5f98e-kube-api-access-h2r8k\") pod \"multus-additional-cni-plugins-529zb\" (UID: \"4d49da64-81af-4a0e-9068-f30074a5f98e\") " pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ql6g\" (UniqueName: \"kubernetes.io/projected/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-kube-api-access-8ql6g\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-log-socket\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-kubelet-config\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc4394de-b0de-4efc-aa0b-693780465668-agent-certs\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-netns\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-kubelet\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-netd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-dbus\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-systemd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxs5\" (UniqueName: \"kubernetes.io/projected/d77543a0-9337-4635-bfac-fa85c9be1cce-kube-api-access-krxs5\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-ovn\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-host-slash\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-bin\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.978998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-config\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-script-lib\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.979155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-iptables-alerter-script\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-var-lib-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-node-log\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-env-overrides\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-log-socket\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d77543a0-9337-4635-bfac-fa85c9be1cce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc4394de-b0de-4efc-aa0b-693780465668-konnectivity-ca\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-kubelet-config\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-etc-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-systemd-units\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-slash\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.979663    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:21.979742    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:22.479709308 +0000 UTC m=+3.172615344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:21.980225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.979997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-var-lib-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-node-log\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980372    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-etc-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-iptables-alerter-script\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-netns\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-kubelet\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-netd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-env-overrides\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-systemd-units\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980892    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-dbus\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-slash\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.980949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-systemd\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-ovn\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-host-slash\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.981028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-host-cni-bin\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981824 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc4394de-b0de-4efc-aa0b-693780465668-konnectivity-ca\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.981824 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d77543a0-9337-4635-bfac-fa85c9be1cce-run-openvswitch\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981824 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-script-lib\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.981976 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.981872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d77543a0-9337-4635-bfac-fa85c9be1cce-ovnkube-config\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.985737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.984752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d77543a0-9337-4635-bfac-fa85c9be1cce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:21.985737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.985147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc4394de-b0de-4efc-aa0b-693780465668-agent-certs\") pod \"konnectivity-agent-zfhqz\" (UID: \"dc4394de-b0de-4efc-aa0b-693780465668\") " pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:21.994241 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.994171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ql6g\" (UniqueName: \"kubernetes.io/projected/9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a-kube-api-access-8ql6g\") pod \"iptables-alerter-lv54z\" (UID: \"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a\") " pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:21.996083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:21.996054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxs5\" (UniqueName: \"kubernetes.io/projected/d77543a0-9337-4635-bfac-fa85c9be1cce-kube-api-access-krxs5\") pod \"ovnkube-node-2lmw6\" (UID: \"d77543a0-9337-4635-bfac-fa85c9be1cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:22.003129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.003071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal" event={"ID":"5f07e2ab30e2e8e91d0c170973cc72aa","Type":"ContainerStarted","Data":"0bb5d03ec83a15b15bf809ae79f0a4bc679ab3e00145cb0da9f5f81a7718eee6"}
Jul 15 21:06:22.005100 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.005072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal" event={"ID":"fec18b57cf91a11064c7551a2c57fb49","Type":"ContainerStarted","Data":"7ff1b22f68b24d8caf0e8cefd829095913f5b4869388f6029bf8c209e5e3df4b"}
Jul 15 21:06:22.071563 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.071521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w"
Jul 15 21:06:22.081070 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.081048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tzj2"
Jul 15 21:06:22.086361 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.086330    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4751aaa3_2ea3_4a35_b4bc_939905964f0d.slice/crio-c77f3b73907924fa24da8962b233c2c6d949066226ec6dad61f1d88207c282a1 WatchSource:0}: Error finding container c77f3b73907924fa24da8962b233c2c6d949066226ec6dad61f1d88207c282a1: Status 404 returned error can't find the container with id c77f3b73907924fa24da8962b233c2c6d949066226ec6dad61f1d88207c282a1
Jul 15 21:06:22.090600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.090573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xtlrx"
Jul 15 21:06:22.095956 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.095923    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72d1eb4_235f_4798_93a8_2a305dd3604f.slice/crio-4dee969fceb91bc9e6afc01e3bb8a5dbb690019abc168b21f7e30dc07f3c40cc WatchSource:0}: Error finding container 4dee969fceb91bc9e6afc01e3bb8a5dbb690019abc168b21f7e30dc07f3c40cc: Status 404 returned error can't find the container with id 4dee969fceb91bc9e6afc01e3bb8a5dbb690019abc168b21f7e30dc07f3c40cc
Jul 15 21:06:22.099114 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.099063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmxsd"
Jul 15 21:06:22.108578 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.108493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-529zb"
Jul 15 21:06:22.111204 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.111175    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb278c3c8_f683_4ebe_8a2c_22aa9bbd2bf0.slice/crio-e872303d13e158fb547f0acf4cb9e909170b55403f00d3083e688033008032be WatchSource:0}: Error finding container e872303d13e158fb547f0acf4cb9e909170b55403f00d3083e688033008032be: Status 404 returned error can't find the container with id e872303d13e158fb547f0acf4cb9e909170b55403f00d3083e688033008032be
Jul 15 21:06:22.117705 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.117678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw2nw"
Jul 15 21:06:22.126598 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.126571    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d49da64_81af_4a0e_9068_f30074a5f98e.slice/crio-9cfb43d899f15cda1f97c697281e6052ada0afd72a294d40fdb91647921c91d8 WatchSource:0}: Error finding container 9cfb43d899f15cda1f97c697281e6052ada0afd72a294d40fdb91647921c91d8: Status 404 returned error can't find the container with id 9cfb43d899f15cda1f97c697281e6052ada0afd72a294d40fdb91647921c91d8
Jul 15 21:06:22.127620 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.127601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lv54z"
Jul 15 21:06:22.129684 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.129636    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb878c29b_cb43_44bd_88e8_989972702c34.slice/crio-0d523d4326546a87b00db05b09b454334cc68768c7ca62222e98f8567aab34e9 WatchSource:0}: Error finding container 0d523d4326546a87b00db05b09b454334cc68768c7ca62222e98f8567aab34e9: Status 404 returned error can't find the container with id 0d523d4326546a87b00db05b09b454334cc68768c7ca62222e98f8567aab34e9
Jul 15 21:06:22.135712 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.135610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:22.139430 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.139405    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bed9f75_36c9_4ed2_ac6d_a41fdf17a44a.slice/crio-367ba7b26fcb0caadb26c91c105e1d4b8c9f58b8807f55d88d701a26079b10cd WatchSource:0}: Error finding container 367ba7b26fcb0caadb26c91c105e1d4b8c9f58b8807f55d88d701a26079b10cd: Status 404 returned error can't find the container with id 367ba7b26fcb0caadb26c91c105e1d4b8c9f58b8807f55d88d701a26079b10cd
Jul 15 21:06:22.143048 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.143016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:22.149163 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.149128    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4394de_b0de_4efc_aa0b_693780465668.slice/crio-261040e7eb47e30dc9afbe9e672eaf6b0d2535662c9ddeede85d66a4fdda746d WatchSource:0}: Error finding container 261040e7eb47e30dc9afbe9e672eaf6b0d2535662c9ddeede85d66a4fdda746d: Status 404 returned error can't find the container with id 261040e7eb47e30dc9afbe9e672eaf6b0d2535662c9ddeede85d66a4fdda746d
Jul 15 21:06:22.155310 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:22.155258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77543a0_9337_4635_bfac_fa85c9be1cce.slice/crio-f42e46c494fd2ebd45b68afd7681ee7f1e0acddf229e735263e9a0837d04d7c8 WatchSource:0}: Error finding container f42e46c494fd2ebd45b68afd7681ee7f1e0acddf229e735263e9a0837d04d7c8: Status 404 returned error can't find the container with id f42e46c494fd2ebd45b68afd7681ee7f1e0acddf229e735263e9a0837d04d7c8
Jul 15 21:06:22.199461 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.199414    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:22.382473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.382368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:22.382631 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.382531    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:22.382631 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.382605    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:23.382583256 +0000 UTC m=+4.075489299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:22.483455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.483412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:22.483672 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.483505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:22.483672 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483602    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:22.483672 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483628    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:22.483672 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483642    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:22.483884 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483613    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:22.483884 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483705    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:23.483683709 +0000 UTC m=+4.176589734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:22.483884 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.483735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:23.483721793 +0000 UTC m=+4.176627838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:22.815154 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.815046    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:01:22 +0000 UTC" deadline="2027-12-16 13:20:08.468459516 +0000 UTC"
Jul 15 21:06:22.815154 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.815089    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12448h13m45.653376405s"
Jul 15 21:06:22.996733 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.996676    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:22.996948 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:22.996682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:22.996948 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.996857    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:22.997088 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:22.996941    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:23.009262 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.009227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"f42e46c494fd2ebd45b68afd7681ee7f1e0acddf229e735263e9a0837d04d7c8"}
Jul 15 21:06:23.011245 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.011213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfhqz" event={"ID":"dc4394de-b0de-4efc-aa0b-693780465668","Type":"ContainerStarted","Data":"261040e7eb47e30dc9afbe9e672eaf6b0d2535662c9ddeede85d66a4fdda746d"}
Jul 15 21:06:23.019445 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.019412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tzj2" event={"ID":"c72d1eb4-235f-4798-93a8-2a305dd3604f","Type":"ContainerStarted","Data":"4dee969fceb91bc9e6afc01e3bb8a5dbb690019abc168b21f7e30dc07f3c40cc"}
Jul 15 21:06:23.020818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.020786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w" event={"ID":"4751aaa3-2ea3-4a35-b4bc-939905964f0d","Type":"ContainerStarted","Data":"c77f3b73907924fa24da8962b233c2c6d949066226ec6dad61f1d88207c282a1"}
Jul 15 21:06:23.022423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.022395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lv54z" event={"ID":"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a","Type":"ContainerStarted","Data":"367ba7b26fcb0caadb26c91c105e1d4b8c9f58b8807f55d88d701a26079b10cd"}
Jul 15 21:06:23.024321 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.024288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw2nw" event={"ID":"b878c29b-cb43-44bd-88e8-989972702c34","Type":"ContainerStarted","Data":"0d523d4326546a87b00db05b09b454334cc68768c7ca62222e98f8567aab34e9"}
Jul 15 21:06:23.026185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.026161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerStarted","Data":"9cfb43d899f15cda1f97c697281e6052ada0afd72a294d40fdb91647921c91d8"}
Jul 15 21:06:23.028166 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.028139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmxsd" event={"ID":"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0","Type":"ContainerStarted","Data":"e872303d13e158fb547f0acf4cb9e909170b55403f00d3083e688033008032be"}
Jul 15 21:06:23.031018 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.030991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xtlrx" event={"ID":"57d855b3-769d-428f-8ed8-d4c611187e0d","Type":"ContainerStarted","Data":"68572b156c18812cf60af7b1c3b59cab7c3d4ddab9a128e9ba80ee9cbacafe16"}
Jul 15 21:06:23.166398 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.166297    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:06:23.391328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.391104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:23.391488 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.391304    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:23.391549 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.391515    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:25.391492227 +0000 UTC m=+6.084398267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.492975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.493070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493215    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493282    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:25.49326321 +0000 UTC m=+6.186169237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493829    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493853    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493867    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:23.493964 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.493918    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:25.493901831 +0000 UTC m=+6.186807855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:23.815380 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.815252    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:01:22 +0000 UTC" deadline="2028-01-21 07:21:21.551207464 +0000 UTC"
Jul 15 21:06:23.815380 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.815331    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13306h14m57.735881792s"
Jul 15 21:06:23.996576 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:23.996014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:23.996576 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:23.996162    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:24.044065 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.043186    2581 generic.go:356] "Generic (PLEG): container finished" podID="fec18b57cf91a11064c7551a2c57fb49" containerID="4216b69c39068cfc6f7f5b796933c00d7e0565fdb112c36c33b7b6e1e8c4b711" exitCode=0
Jul 15 21:06:24.044065 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.043282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal" event={"ID":"fec18b57cf91a11064c7551a2c57fb49","Type":"ContainerDied","Data":"4216b69c39068cfc6f7f5b796933c00d7e0565fdb112c36c33b7b6e1e8c4b711"}
Jul 15 21:06:24.064530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.064451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal" event={"ID":"5f07e2ab30e2e8e91d0c170973cc72aa","Type":"ContainerStarted","Data":"68e8623c19125017acb96eece3e28df153966422622488214c0e7073a557a6fb"}
Jul 15 21:06:24.081401 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.081328    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-60.ec2.internal" podStartSLOduration=3.081306173 podStartE2EDuration="3.081306173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:24.081119025 +0000 UTC m=+4.774025075" watchObservedRunningTime="2026-07-15 21:06:24.081306173 +0000 UTC m=+4.774212220"
Jul 15 21:06:24.996632 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.996596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:24.997247 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:24.996754    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:24.997247 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:24.997167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:24.997411 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:24.997268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:25.105209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:25.105146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal" event={"ID":"fec18b57cf91a11064c7551a2c57fb49","Type":"ContainerStarted","Data":"ac4e4f0081eca89bf8a156593a0b2d0f57b53f95c8195a700d7f7ba3fa896b71"}
Jul 15 21:06:25.414685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:25.414603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:25.414888 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.414811    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:25.414888 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.414875    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:29.414855203 +0000 UTC m=+10.107761229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:25.515218 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:25.515175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:25.515472 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:25.515259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:25.515472 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515448    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:25.515472 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515471    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:25.515663 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515484    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:25.515663 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515546    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:29.51552599 +0000 UTC m=+10.208432014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:25.515801 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515680    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:25.515801 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.515740    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:29.515725605 +0000 UTC m=+10.208631648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:25.999194 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:25.999155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:25.999710 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:25.999389    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:26.996612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:26.996574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:26.996837 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:26.996722    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:26.997320 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:26.997091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:26.997320 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:26.997270    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:27.996483 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:27.996397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:27.996856 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:27.996544    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:28.995841 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:28.995809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:28.996014 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:28.995946    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:28.996404 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:28.996362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:28.996552 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:28.996528    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:29.452318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:29.452112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:29.452318 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.452300    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:29.452577 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.452372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.452353279 +0000 UTC m=+18.145259318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:29.553357 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:29.553319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:29.553543 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:29.553386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:29.553543 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553512    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:29.553648 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553585    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.553563505 +0000 UTC m=+18.246469547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:29.553648 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553514    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:29.553648 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553615    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:29.553648 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553629    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:29.553841 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.553667    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.553656868 +0000 UTC m=+18.246562888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:29.997549 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:29.997240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:29.997549 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:29.997369    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:30.996744 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:30.996704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:30.996931 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:30.996836    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:30.997006 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:30.996937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:30.997101 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:30.997071    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:31.996625 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:31.996586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:31.997016 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:31.996725    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:32.996611 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:32.996582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:32.996763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:32.996627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:32.996763 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:32.996706    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:32.997193 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:32.996864    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:33.996042 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:33.995939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:33.996236 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:33.996102    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:34.996481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:34.996439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:34.996928 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:34.996447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:34.996928 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:34.996594    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:34.996928 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:34.996660    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:35.996848 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:35.996806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:35.997266 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:35.996928    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:36.996056 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:36.996021    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:36.996272 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:36.996024    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:36.996272 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:36.996158    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:36.996272 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:36.996216    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:37.517802 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:37.517763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:37.518189 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.517909    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:37.518189 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.517986    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:53.517966958 +0000 UTC m=+34.210872981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:37.618519 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:37.618465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:37.618717 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:37.618538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:37.618717 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618650    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:37.618717 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618688    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:37.618717 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618711    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:37.618910 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618724    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:37.618910 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618730    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:06:53.618708139 +0000 UTC m=+34.311614182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:37.618910 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.618786    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:06:53.618770605 +0000 UTC m=+34.311676661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:37.995874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:37.995790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:37.996043 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:37.995916    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:38.995903 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:38.995864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:38.996352 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:38.995871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:38.996352 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:38.996020    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:38.996352 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:38.996095    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:39.997458 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:39.997424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:39.997890 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:39.997537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:40.995996 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:40.995885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:40.995996 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:40.995893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:40.996304 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:40.996026    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:40.996304 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:40.996141    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:41.995743 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:41.995716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:41.996051 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:41.995841    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:42.148070 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.147769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw2nw" event={"ID":"b878c29b-cb43-44bd-88e8-989972702c34","Type":"ContainerStarted","Data":"10d57bf9a02abbe97e5f981ed9eafc65f660459ad67934b039c633e18f800970"}
Jul 15 21:06:42.149831 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.149781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerStarted","Data":"b1ab50d5c8eaa9891576c196c2f054afa77bcaa71ff123c3b35995813a163808"}
Jul 15 21:06:42.151806 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.151765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmxsd" event={"ID":"b278c3c8-f683-4ebe-8a2c-22aa9bbd2bf0","Type":"ContainerStarted","Data":"b91edd6d3ea6b45cdb21c7219807766fdbaf837262a4c81fda327db7667266a0"}
Jul 15 21:06:42.158034 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.158006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xtlrx" event={"ID":"57d855b3-769d-428f-8ed8-d4c611187e0d","Type":"ContainerStarted","Data":"4fb059c9d43cdf530c444c4a888674e81aced205f55097a3c478118e4495298b"}
Jul 15 21:06:42.159361 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.159341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfhqz" event={"ID":"dc4394de-b0de-4efc-aa0b-693780465668","Type":"ContainerStarted","Data":"88f56c193c873a45edd4dcc51d1fdf6d424403bed8565099f2a9fcf04f5b638c"}
Jul 15 21:06:42.160749 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.160730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tzj2" event={"ID":"c72d1eb4-235f-4798-93a8-2a305dd3604f","Type":"ContainerStarted","Data":"d2017b39bdb30d8abb6b185b9769ba6ee215b3b2aaf7cc3794fe6c56ca371701"}
Jul 15 21:06:42.163566 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.163529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zw2nw" podStartSLOduration=2.608969101 podStartE2EDuration="22.163514477s" totalImagesPullingTime="19.554545376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:42.163033034 +0000 UTC m=+22.855939073" watchObservedRunningTime="2026-07-15 21:06:42.163514477 +0000 UTC m=+22.856420520"
Jul 15 21:06:42.163976 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.163940    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-60.ec2.internal" podStartSLOduration=21.163930655 podStartE2EDuration="21.163930655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:25.123523313 +0000 UTC m=+5.816429359" watchObservedRunningTime="2026-07-15 21:06:42.163930655 +0000 UTC m=+22.856836696"
Jul 15 21:06:42.202671 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.202589    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5tzj2" podStartSLOduration=2.303352042 podStartE2EDuration="22.202573104s" totalImagesPullingTime="19.899221062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:42.20212988 +0000 UTC m=+22.895035921" watchObservedRunningTime="2026-07-15 21:06:42.202573104 +0000 UTC m=+22.895479144"
Jul 15 21:06:42.216965 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.216913    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xtlrx" podStartSLOduration=2.637460203 podStartE2EDuration="22.216880692s" totalImagesPullingTime="19.579420489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:42.216544091 +0000 UTC m=+22.909450132" watchObservedRunningTime="2026-07-15 21:06:42.216880692 +0000 UTC m=+22.909786790"
Jul 15 21:06:42.239998 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.239955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rmxsd" podStartSLOduration=2.388264391 podStartE2EDuration="22.239936073s" totalImagesPullingTime="19.851671682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:42.239850925 +0000 UTC m=+22.932756966" watchObservedRunningTime="2026-07-15 21:06:42.239936073 +0000 UTC m=+22.932842114"
Jul 15 21:06:42.258179 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.258133    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfhqz" podStartSLOduration=1.44542748 podStartE2EDuration="21.258118021s" totalImagesPullingTime="19.812690541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:42.257639156 +0000 UTC m=+22.950545196" watchObservedRunningTime="2026-07-15 21:06:42.258118021 +0000 UTC m=+22.951024062"
Jul 15 21:06:42.996814 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.996560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:42.997705 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:42.996588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:42.997705 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:42.996942    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:42.997705 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:42.997016    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:43.163810 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.163785    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="b1ab50d5c8eaa9891576c196c2f054afa77bcaa71ff123c3b35995813a163808" exitCode=0
Jul 15 21:06:43.163946 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.163862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"b1ab50d5c8eaa9891576c196c2f054afa77bcaa71ff123c3b35995813a163808"}
Jul 15 21:06:43.170042 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:06:43.170402 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170378    2581 generic.go:356] "Generic (PLEG): container finished" podID="d77543a0-9337-4635-bfac-fa85c9be1cce" containerID="205d0c04d08cd1dc66e0530363d0ae977d2e43b86d50db9accb639a3cd86a5e5" exitCode=1
Jul 15 21:06:43.170506 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"3e529807556c737a3b63b7bd3eac9730c376142e0f24dc6297a2f9c000db2671"}
Jul 15 21:06:43.170567 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"e279e6fd9e9bc065781b5948d42c1432ce08934f296b07b1269d5a8cd3fbafc6"}
Jul 15 21:06:43.170626 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"04d9349982410b4267d1cc82a89fc4afced740406f7af8377347c1a2457a50f7"}
Jul 15 21:06:43.170679 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"3e744fdc9b0dce028920164617a4710f95952e86b5e2bfef2625577f23f23748"}
Jul 15 21:06:43.170730 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerDied","Data":"205d0c04d08cd1dc66e0530363d0ae977d2e43b86d50db9accb639a3cd86a5e5"}
Jul 15 21:06:43.170785 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.170745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"2e6c6f850ad3557f9a918b2f33e16a29507857c6ad5add04d4d280a5a6552fbf"}
Jul 15 21:06:43.171685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.171657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w" event={"ID":"4751aaa3-2ea3-4a35-b4bc-939905964f0d","Type":"ContainerStarted","Data":"d7d5e087facf4fd902e134b2aa03e6b5b61f8f2f9086e12bdc982a100366b73f"}
Jul 15 21:06:43.272465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.272441    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 21:06:43.893941 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.893823    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:06:43.272459593Z","UUID":"d7511713-3aa6-4632-8638-d7c74c118499","Handler":null,"Name":"","Endpoint":""}
Jul 15 21:06:43.895481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.895457    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 21:06:43.895607 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.895504    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 21:06:43.996320 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:43.995824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:43.996320 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:43.995955    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:44.175980 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:44.175896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w" event={"ID":"4751aaa3-2ea3-4a35-b4bc-939905964f0d","Type":"ContainerStarted","Data":"d790ab988a0eb0f0a3c5c03906f4b21e809b1ed5a03d48d224e6c4cd9e2c7157"}
Jul 15 21:06:44.177301 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:44.177262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lv54z" event={"ID":"9bed9f75-36c9-4ed2-ac6d-a41fdf17a44a","Type":"ContainerStarted","Data":"c5304227298eb3bc1dcbf8d7d1586b2d2fca3a7c076a6a1cce411e76ad138d76"}
Jul 15 21:06:44.194196 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:44.194137    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lv54z" podStartSLOduration=4.387675004 podStartE2EDuration="24.194116625s" totalImagesPullingTime="19.806441621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:44.193194078 +0000 UTC m=+24.886100151" watchObservedRunningTime="2026-07-15 21:06:44.194116625 +0000 UTC m=+24.887022668"
Jul 15 21:06:44.996177 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:44.995958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:44.996342 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:44.995989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:44.996342 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:44.996274    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:44.996467 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:44.996397    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:45.184400 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:45.184365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:06:45.184892 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:45.184860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"5f800d404a7f7fca4a327b2563c8fec76b334ba5928acc2f2a639748016a0c2a"}
Jul 15 21:06:45.191396 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:45.191240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w" event={"ID":"4751aaa3-2ea3-4a35-b4bc-939905964f0d","Type":"ContainerStarted","Data":"2efc6792516d0f9756a274c119da59e36405bb0bddd8e5bf25dbe8b4df9bef6b"}
Jul 15 21:06:45.209701 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:45.209649    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gpc8w" podStartSLOduration=3.363265709 podStartE2EDuration="25.20963419s" totalImagesPullingTime="21.846368481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:45.209381023 +0000 UTC m=+25.902287100" watchObservedRunningTime="2026-07-15 21:06:45.20963419 +0000 UTC m=+25.902540230"
Jul 15 21:06:45.996342 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:45.996307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:45.996614 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:45.996425    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:46.484897 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:46.484816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:46.485563 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:46.485416    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:46.996647 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:46.996616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:46.996830 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:46.996744    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:46.996830 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:46.996801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:46.996943 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:46.996917    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:47.195938 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:47.195902    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:47.196520 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:47.196499    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfhqz"
Jul 15 21:06:47.996307 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:47.996033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:47.996848 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:47.996364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:48.199739 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.199712    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="f038e7b6465501f89f0f4f87093fde9626f2fd9f4e5a3fbcf88a405da70846b4" exitCode=0
Jul 15 21:06:48.199893 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.199803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"f038e7b6465501f89f0f4f87093fde9626f2fd9f4e5a3fbcf88a405da70846b4"}
Jul 15 21:06:48.203441 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.203384    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:06:48.203855 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.203831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"ef46a566035efa3aad6642031aa10414d8c2d95f07c809c5d091505cca112ad4"}
Jul 15 21:06:48.204171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.204153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:48.204239 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.204228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:48.204319 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.204305    2581 scope.go:117] "RemoveContainer" containerID="205d0c04d08cd1dc66e0530363d0ae977d2e43b86d50db9accb639a3cd86a5e5"
Jul 15 21:06:48.221358 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.221244    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:48.996224 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.996193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:48.996496 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:48.996339    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:48.996496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:48.996395    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:48.996848 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:48.996526    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:49.209942 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.209917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:06:49.210399 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.210364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" event={"ID":"d77543a0-9337-4635-bfac-fa85c9be1cce","Type":"ContainerStarted","Data":"76f0e768127760f1933a3c70f9ec6389a2a4bcb3ebf5dc58296c71bb08d19f5a"}
Jul 15 21:06:49.210653 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.210634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:49.226008 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.225981    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:06:49.238541 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.238493    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6" podStartSLOduration=8.10726811 podStartE2EDuration="28.238478768s" totalImagesPullingTime="20.131210658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:49.237280098 +0000 UTC m=+29.930186139" watchObservedRunningTime="2026-07-15 21:06:49.238478768 +0000 UTC m=+29.931384809"
Jul 15 21:06:49.773607 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.773146    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qv9r5"]
Jul 15 21:06:49.773607 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.773595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:49.773825 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:49.773720    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:49.773982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.773962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6sdk"]
Jul 15 21:06:49.774071 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.774058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:49.774141 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:49.774124    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:49.775194 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.775175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zl9lr"]
Jul 15 21:06:49.775310 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:49.775256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:49.775362 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:49.775349    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:50.214352 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:50.214257    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="e6cbe6d1fea25db4638f0716123bc8c56ca1312a081ecf9225aab597d61a70fc" exitCode=0
Jul 15 21:06:50.214352 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:50.214321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"e6cbe6d1fea25db4638f0716123bc8c56ca1312a081ecf9225aab597d61a70fc"}
Jul 15 21:06:51.995995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:51.995910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:51.995995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:51.995911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:51.996735 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:51.996010    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:51.996735 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:51.996029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:51.996735 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:51.996109    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:51.996735 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:51.996198    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:52.222176 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:52.222142    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="80f60ac765dc4c783ff985a16314c7502d1120f311fd1c578ceeb68abeb9f7ef" exitCode=0
Jul 15 21:06:52.222335 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:52.222207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"80f60ac765dc4c783ff985a16314c7502d1120f311fd1c578ceeb68abeb9f7ef"}
Jul 15 21:06:53.540919 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.540825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:53.541415 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.540968    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:53.541415 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.541038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs podName:c11b51b4-df9b-4eb9-be85-7b6642653077 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:25.541016263 +0000 UTC m=+66.233922299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs") pod "network-metrics-daemon-zl9lr" (UID: "c11b51b4-df9b-4eb9-be85-7b6642653077") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:06:53.641407 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.641357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:53.641606 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.641457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:53.641606 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641528    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:06:53.641606 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641551    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:06:53.641606 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641561    2581 projected.go:196] Error preparing data for projected volume kube-api-access-q8nfr for pod openshift-network-diagnostics/network-check-target-t6sdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:53.641606 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641565    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:53.641776 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret podName:07054f71-c3a8-4f1b-bee5-c7977c1a15ab nodeName:}" failed. No retries permitted until 2026-07-15 21:07:25.641613366 +0000 UTC m=+66.334519406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret") pod "global-pull-secret-syncer-qv9r5" (UID: "07054f71-c3a8-4f1b-bee5-c7977c1a15ab") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:06:53.641776 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.641642    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr podName:6dfe684e-6716-4d47-80ba-9f77e46eba8b nodeName:}" failed. No retries permitted until 2026-07-15 21:07:25.641636552 +0000 UTC m=+66.334542573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8nfr" (UniqueName: "kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr") pod "network-check-target-t6sdk" (UID: "6dfe684e-6716-4d47-80ba-9f77e46eba8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:06:53.996441 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.996337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:53.996441 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.996349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:53.996673 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.996471    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6sdk" podUID="6dfe684e-6716-4d47-80ba-9f77e46eba8b"
Jul 15 21:06:53.996673 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.996584    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv9r5" podUID="07054f71-c3a8-4f1b-bee5-c7977c1a15ab"
Jul 15 21:06:53.996673 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:53.996352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:53.996824 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:53.996706    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl9lr" podUID="c11b51b4-df9b-4eb9-be85-7b6642653077"
Jul 15 21:06:54.616063 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.616030    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-60.ec2.internal" event="NodeReady"
Jul 15 21:06:54.616497 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.616183    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 21:06:54.756651 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.756611    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:06:54.758761 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.758728    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q6phd"]
Jul 15 21:06:54.758922 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.758866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.761554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.761486    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cpj54"]
Jul 15 21:06:54.762203 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.761982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.765763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.763307    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 21:06:54.765763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.763558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 21:06:54.765763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.763872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 21:06:54.765763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.765687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zhpfs\""
Jul 15 21:06:54.766034 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.765768    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 21:06:54.766034 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.765887    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 21:06:54.766155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.766098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.767899 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.767852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mhzfs\""
Jul 15 21:06:54.778175 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.778154    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 21:06:54.778305 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.778163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 21:06:54.779650 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.779629    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 21:06:54.780725 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.780706    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2hd4\""
Jul 15 21:06:54.791599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.791575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cpj54"]
Jul 15 21:06:54.800838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.800811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:06:54.807485 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.807461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 21:06:54.809716 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.809692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q6phd"]
Jul 15 21:06:54.849753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.849753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.849930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572382a0-06b2-49c3-a09c-23df0a6baea2-cert\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.849930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-config-volume\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.849930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.849930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.850119 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.849943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-tmp-dir\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.850119 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxh9\" (UniqueName: \"kubernetes.io/projected/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-kube-api-access-7gxh9\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.850119 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.850119 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.850256 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsfgx\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.850256 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.850256 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.850256 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.850191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bprrp\" (UniqueName: \"kubernetes.io/projected/572382a0-06b2-49c3-a09c-23df0a6baea2-kube-api-access-bprrp\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.951003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.950963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572382a0-06b2-49c3-a09c-23df0a6baea2-cert\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-config-volume\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-tmp-dir\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxh9\" (UniqueName: \"kubernetes.io/projected/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-kube-api-access-7gxh9\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsfgx\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:54.951228    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:54.951264    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:54.951298    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:54.951321    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:55.451296213 +0000 UTC m=+36.144202249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bprrp\" (UniqueName: \"kubernetes.io/projected/572382a0-06b2-49c3-a09c-23df0a6baea2-kube-api-access-bprrp\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.951554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-tmp-dir\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.952094 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:54.951569    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:06:55.451550652 +0000 UTC m=+36.144456684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:06:54.952094 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951706    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.952094 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.951779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-config-volume\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.952240 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.952101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.952988 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.952943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.956895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.956711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.957022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.956731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572382a0-06b2-49c3-a09c-23df0a6baea2-cert\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.957106 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.957079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.965530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.965504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxh9\" (UniqueName: \"kubernetes.io/projected/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-kube-api-access-7gxh9\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:54.965821 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.965798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:54.965917 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.965824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bprrp\" (UniqueName: \"kubernetes.io/projected/572382a0-06b2-49c3-a09c-23df0a6baea2-kube-api-access-bprrp\") pod \"ingress-canary-cpj54\" (UID: \"572382a0-06b2-49c3-a09c-23df0a6baea2\") " pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:54.967587 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:54.967563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsfgx\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:55.088053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.087913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cpj54"
Jul 15 21:06:55.237830 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.237797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cpj54"]
Jul 15 21:06:55.455843 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.455750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:55.455843 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.455808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:55.456083 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:55.455915    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:06:55.456083 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:55.455990    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:56.455973552 +0000 UTC m=+37.148879571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:06:55.456083 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:55.455918    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:06:55.456083 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:55.456038    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:06:55.456083 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:55.456080    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:06:56.456063856 +0000 UTC m=+37.148969899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:06:55.996183 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.996143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:06:55.996939 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.996143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:06:55.996939 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.996147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:06:55.999361 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999339    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:06:55.999488 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999396    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:06:55.999488 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v4wmg\""
Jul 15 21:06:55.999488 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jw9wn\""
Jul 15 21:06:55.999488 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999457    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:06:55.999488 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:55.999484    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:06:56.278697 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.278607    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"]
Jul 15 21:06:56.281719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.281627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"
Jul 15 21:06:56.282027 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.281880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"]
Jul 15 21:06:56.283654 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.283624    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 21:06:56.283770 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.283704    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:06:56.283770 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.283732    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"]
Jul 15 21:06:56.283880 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.283709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2w4fz\""
Jul 15 21:06:56.283880 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.283857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.285481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.285463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.285604 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.285553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 21:06:56.285666 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.285633    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:06:56.286052 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.286027    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 21:06:56.286142 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.286086    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qmt2q\""
Jul 15 21:06:56.287119 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.287101    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 21:06:56.287243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.287184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zfr7m\""
Jul 15 21:06:56.287696 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.287428    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 21:06:56.287696 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.287508    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 21:06:56.288549 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.288344    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 21:06:56.292830 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.292805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"]
Jul 15 21:06:56.296235 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.296213    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"]
Jul 15 21:06:56.296737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.296720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"]
Jul 15 21:06:56.362308 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.362252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnp5b\" (UniqueName: \"kubernetes.io/projected/1255b2fb-1ef8-4f0a-8d98-c593cc111992-kube-api-access-jnp5b\") pod \"volume-data-source-validator-78495597f6-4jncp\" (UID: \"1255b2fb-1ef8-4f0a-8d98-c593cc111992\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"
Jul 15 21:06:56.362308 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.362309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.362511 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.362362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cnb\" (UniqueName: \"kubernetes.io/projected/892f3989-2377-4cd3-ade4-8506e5384e1f-kube-api-access-w4cnb\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.384998 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.384968    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jsl4p"]
Jul 15 21:06:56.387970 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.387940    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6547f5d7b6-qlhfc"]
Jul 15 21:06:56.388118 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.388092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.389848 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.389829    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.390777 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.390752    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 21:06:56.390902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.390764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 21:06:56.390902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.390814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 21:06:56.390902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.390827    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 21:06:56.390902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.390834    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g9kv4\""
Jul 15 21:06:56.392085 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392061    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 21:06:56.392209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392112    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 21:06:56.392209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 21:06:56.392326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392275    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 21:06:56.392397 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392335    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 21:06:56.392642 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392621    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j2mp4\""
Jul 15 21:06:56.392642 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.392636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 21:06:56.400853 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.400829    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 21:06:56.401245 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.401224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jsl4p"]
Jul 15 21:06:56.404430 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.404410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6547f5d7b6-qlhfc"]
Jul 15 21:06:56.463116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43378288-071e-480b-a104-4f2550a04243-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.463332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d887k\" (UniqueName: \"kubernetes.io/projected/43378288-071e-480b-a104-4f2550a04243-kube-api-access-d887k\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.463332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:56.463332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:56.463332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnp5b\" (UniqueName: \"kubernetes.io/projected/1255b2fb-1ef8-4f0a-8d98-c593cc111992-kube-api-access-jnp5b\") pod \"volume-data-source-validator-78495597f6-4jncp\" (UID: \"1255b2fb-1ef8-4f0a-8d98-c593cc111992\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"
Jul 15 21:06:56.463332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463360    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463383    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463393    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463439    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:06:58.463423403 +0000 UTC m=+39.156329423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463458    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463493    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:58.463477594 +0000 UTC m=+39.156383619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.463514    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:56.9635045 +0000 UTC m=+37.656410532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:06:56.463579 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.463561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cnb\" (UniqueName: \"kubernetes.io/projected/892f3989-2377-4cd3-ade4-8506e5384e1f-kube-api-access-w4cnb\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.473127 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.473086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnp5b\" (UniqueName: \"kubernetes.io/projected/1255b2fb-1ef8-4f0a-8d98-c593cc111992-kube-api-access-jnp5b\") pod \"volume-data-source-validator-78495597f6-4jncp\" (UID: \"1255b2fb-1ef8-4f0a-8d98-c593cc111992\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"
Jul 15 21:06:56.473489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.473470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cnb\" (UniqueName: \"kubernetes.io/projected/892f3989-2377-4cd3-ade4-8506e5384e1f-kube-api-access-w4cnb\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.564952 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.564849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-default-certificate\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.565129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.564963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.565129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-snapshots\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-tmp\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.565315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-stats-auth\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.565315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhfb9\" (UniqueName: \"kubernetes.io/projected/db887899-543c-44a1-92af-f0b649be473d-kube-api-access-hhfb9\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.565315 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.565279    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:56.565315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d887k\" (UniqueName: \"kubernetes.io/projected/43378288-071e-480b-a104-4f2550a04243-kube-api-access-d887k\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.565551 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.565381    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:57.065357455 +0000 UTC m=+37.758263480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:56.565551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565660 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c50e517-86eb-4424-9c60-1054353518ea-serving-cert\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565660 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565756 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.565756 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xkd2\" (UniqueName: \"kubernetes.io/projected/5c50e517-86eb-4424-9c60-1054353518ea-kube-api-access-5xkd2\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.565852 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.565776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43378288-071e-480b-a104-4f2550a04243-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.566580 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.566557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43378288-071e-480b-a104-4f2550a04243-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.576702 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.576673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d887k\" (UniqueName: \"kubernetes.io/projected/43378288-071e-480b-a104-4f2550a04243-kube-api-access-d887k\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:56.593665 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.593635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"
Jul 15 21:06:56.667091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xkd2\" (UniqueName: \"kubernetes.io/projected/5c50e517-86eb-4424-9c60-1054353518ea-kube-api-access-5xkd2\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-default-certificate\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.667375 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.667375 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-snapshots\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-tmp\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-stats-auth\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.667595 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.667549    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:06:56.667644 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.667617    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:57.167597157 +0000 UTC m=+37.860503198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:06:56.667697 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhfb9\" (UniqueName: \"kubernetes.io/projected/db887899-543c-44a1-92af-f0b649be473d-kube-api-access-hhfb9\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.667697 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667781 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c50e517-86eb-4424-9c60-1054353518ea-serving-cert\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667781 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.667863 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.667791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.668066 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.667948    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:57.167933096 +0000 UTC m=+37.860839139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:06:56.668439 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.668299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-snapshots\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.668439 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.668334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c50e517-86eb-4424-9c60-1054353518ea-tmp\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.668605 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.668563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.668958 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.668913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c50e517-86eb-4424-9c60-1054353518ea-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.670260 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.670238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-stats-auth\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.670389 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.670246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-default-certificate\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.670618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.670599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c50e517-86eb-4424-9c60-1054353518ea-serving-cert\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.676365 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.676340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhfb9\" (UniqueName: \"kubernetes.io/projected/db887899-543c-44a1-92af-f0b649be473d-kube-api-access-hhfb9\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:56.676551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.676527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xkd2\" (UniqueName: \"kubernetes.io/projected/5c50e517-86eb-4424-9c60-1054353518ea-kube-api-access-5xkd2\") pod \"insights-operator-68d9dd94cf-jsl4p\" (UID: \"5c50e517-86eb-4424-9c60-1054353518ea\") " pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.691490 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:56.691461    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572382a0_06b2_49c3_a09c_23df0a6baea2.slice/crio-76437bd9d0aaf1237cd08a15756611138929c85e3ad94e3267adfa5fab6bfa21 WatchSource:0}: Error finding container 76437bd9d0aaf1237cd08a15756611138929c85e3ad94e3267adfa5fab6bfa21: Status 404 returned error can't find the container with id 76437bd9d0aaf1237cd08a15756611138929c85e3ad94e3267adfa5fab6bfa21
Jul 15 21:06:56.702494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.702472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p"
Jul 15 21:06:56.858851 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.858826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp"]
Jul 15 21:06:56.862068 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:56.862044    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1255b2fb_1ef8_4f0a_8d98_c593cc111992.slice/crio-25db581f4b977718e8a800734fecc3862e0c7cd65cf260dc64c636e119a564a0 WatchSource:0}: Error finding container 25db581f4b977718e8a800734fecc3862e0c7cd65cf260dc64c636e119a564a0: Status 404 returned error can't find the container with id 25db581f4b977718e8a800734fecc3862e0c7cd65cf260dc64c636e119a564a0
Jul 15 21:06:56.877113 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.876934    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jsl4p"]
Jul 15 21:06:56.882013 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:56.881986    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c50e517_86eb_4424_9c60_1054353518ea.slice/crio-aee93c7a6385f0b57b11dfb39412ef142f3e13db96461820bce9c4cd1e381676 WatchSource:0}: Error finding container aee93c7a6385f0b57b11dfb39412ef142f3e13db96461820bce9c4cd1e381676: Status 404 returned error can't find the container with id aee93c7a6385f0b57b11dfb39412ef142f3e13db96461820bce9c4cd1e381676
Jul 15 21:06:56.974310 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:56.974259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:56.974454 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.974434    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:06:56.974509 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:56.974502    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:57.974485521 +0000 UTC m=+38.667391542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:06:57.075249 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.075212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:57.075645 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.075397    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:57.075645 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.075473    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:58.075454793 +0000 UTC m=+38.768360813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:57.175797 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.175708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:57.175797 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.175760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:57.175980 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.175890    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:58.175869847 +0000 UTC m=+38.868775867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:06:57.175980 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.175892    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:06:57.175980 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.175935    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:06:58.175928177 +0000 UTC m=+38.868834197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:06:57.211032 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.210995    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-zmvlv"]
Jul 15 21:06:57.213042 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.213018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.214903 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.214873    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:06:57.215004 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.214915    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 21:06:57.215295 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.215264    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 21:06:57.215389 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.215311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tsln2\""
Jul 15 21:06:57.215389 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.215315    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 21:06:57.220995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.220896    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 21:06:57.224694 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.224675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zmvlv"]
Jul 15 21:06:57.234741 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.234714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p" event={"ID":"5c50e517-86eb-4424-9c60-1054353518ea","Type":"ContainerStarted","Data":"aee93c7a6385f0b57b11dfb39412ef142f3e13db96461820bce9c4cd1e381676"}
Jul 15 21:06:57.235772 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.235750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp" event={"ID":"1255b2fb-1ef8-4f0a-8d98-c593cc111992","Type":"ContainerStarted","Data":"25db581f4b977718e8a800734fecc3862e0c7cd65cf260dc64c636e119a564a0"}
Jul 15 21:06:57.236898 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.236875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cpj54" event={"ID":"572382a0-06b2-49c3-a09c-23df0a6baea2","Type":"ContainerStarted","Data":"76437bd9d0aaf1237cd08a15756611138929c85e3ad94e3267adfa5fab6bfa21"}
Jul 15 21:06:57.239492 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.239467    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="0d4f4d24ec2f1413dd443ae94797cba37afa2d802fff48ec003971abea83c308" exitCode=0
Jul 15 21:06:57.239570 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.239512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"0d4f4d24ec2f1413dd443ae94797cba37afa2d802fff48ec003971abea83c308"}
Jul 15 21:06:57.378063 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.378023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr7t\" (UniqueName: \"kubernetes.io/projected/cb21e43a-08ca-42d3-9faa-903a5290ea4b-kube-api-access-thr7t\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.378212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.378099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-config\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.378274 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.378252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-trusted-ca\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.378422 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.378394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb21e43a-08ca-42d3-9faa-903a5290ea4b-serving-cert\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.480091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.479685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thr7t\" (UniqueName: \"kubernetes.io/projected/cb21e43a-08ca-42d3-9faa-903a5290ea4b-kube-api-access-thr7t\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.480091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.479776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-config\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.480091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.479862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-trusted-ca\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.480091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.479901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb21e43a-08ca-42d3-9faa-903a5290ea4b-serving-cert\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.480950 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.480863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-config\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.481121 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.481095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb21e43a-08ca-42d3-9faa-903a5290ea4b-trusted-ca\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.484594 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.484565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb21e43a-08ca-42d3-9faa-903a5290ea4b-serving-cert\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.491708 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.491661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr7t\" (UniqueName: \"kubernetes.io/projected/cb21e43a-08ca-42d3-9faa-903a5290ea4b-kube-api-access-thr7t\") pod \"console-operator-7866497494-zmvlv\" (UID: \"cb21e43a-08ca-42d3-9faa-903a5290ea4b\") " pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.522851 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.522813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:06:57.672017 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.671972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zmvlv"]
Jul 15 21:06:57.675877 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:06:57.675840    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb21e43a_08ca_42d3_9faa_903a5290ea4b.slice/crio-69d42176fe4227c255226e0721e92f72aba95acc3116ea889e1d9fcc23b1013d WatchSource:0}: Error finding container 69d42176fe4227c255226e0721e92f72aba95acc3116ea889e1d9fcc23b1013d: Status 404 returned error can't find the container with id 69d42176fe4227c255226e0721e92f72aba95acc3116ea889e1d9fcc23b1013d
Jul 15 21:06:57.985320 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:57.985265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:06:57.985481 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.985406    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:06:57.985560 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:57.985488    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:59.985467019 +0000 UTC m=+40.678373064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:06:58.086136 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.086103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:06:58.087037 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.086229    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:58.087037 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.086316    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:00.086276504 +0000 UTC m=+40.779182539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:06:58.187563 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.187526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:58.187736 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.187613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:06:58.187736 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.187718    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:00.18769505 +0000 UTC m=+40.880601076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:06:58.187866 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.187790    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:06:58.187866 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.187841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:00.187825486 +0000 UTC m=+40.880731508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:06:58.245629 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.245337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp" event={"ID":"1255b2fb-1ef8-4f0a-8d98-c593cc111992","Type":"ContainerStarted","Data":"d6b837f4a1bdc8a5b80d6e611803e81fc0c23bf8f067c830a8edfaae84b39a8c"}
Jul 15 21:06:58.250309 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.250257    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d49da64-81af-4a0e-9068-f30074a5f98e" containerID="c2cab75783e1309ce6f14421e54bc4903a99c12671dc7ea69d4f6a136e6b1cf4" exitCode=0
Jul 15 21:06:58.250597 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.250308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerDied","Data":"c2cab75783e1309ce6f14421e54bc4903a99c12671dc7ea69d4f6a136e6b1cf4"}
Jul 15 21:06:58.253096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.253044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zmvlv" event={"ID":"cb21e43a-08ca-42d3-9faa-903a5290ea4b","Type":"ContainerStarted","Data":"69d42176fe4227c255226e0721e92f72aba95acc3116ea889e1d9fcc23b1013d"}
Jul 15 21:06:58.262748 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.262370    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4jncp" podStartSLOduration=1.008885736 podStartE2EDuration="2.262058313s" totalImagesPullingTime="1.253172577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:58.261985484 +0000 UTC m=+38.954891529" watchObservedRunningTime="2026-07-15 21:06:58.262058313 +0000 UTC m=+38.954964356"
Jul 15 21:06:58.492052 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.492021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:06:58.492237 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:58.492063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:06:58.492237 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.492233    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:06:58.492367 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.492316    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:02.492273606 +0000 UTC m=+43.185179628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:06:58.492716 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.492691    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:06:58.492813 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.492720    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:06:58.492813 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:06:58.492774    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:07:02.492756839 +0000 UTC m=+43.185662881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:06:59.260044 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:59.259998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-529zb" event={"ID":"4d49da64-81af-4a0e-9068-f30074a5f98e","Type":"ContainerStarted","Data":"cb7f76f0054314059bcc8fa142b859b0061bf57074000f26c47557ecca3e1100"}
Jul 15 21:06:59.283818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:06:59.283763    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-529zb" podStartSLOduration=8.266810658 podStartE2EDuration="39.283744772s" totalImagesPullingTime="31.016934114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:59.282525526 +0000 UTC m=+39.975431572" watchObservedRunningTime="2026-07-15 21:06:59.283744772 +0000 UTC m=+39.976650814"
Jul 15 21:07:00.005385 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:00.005349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:00.005587 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.005491    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:07:00.005587 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.005556    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:07:04.005538933 +0000 UTC m=+44.698444956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:07:00.106724 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:00.106665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:00.106902 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.106829    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:00.106948 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.106907    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:04.106887312 +0000 UTC m=+44.799793343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:00.208273 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:00.208225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:00.208486 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:00.208327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:00.208486 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.208434    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:04.208410999 +0000 UTC m=+44.901317033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:07:00.208486 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.208472    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:07:00.208665 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:00.208523    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:04.208510089 +0000 UTC m=+44.901416133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:07:01.205599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.205513    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"]
Jul 15 21:07:01.223213 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.223180    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"]
Jul 15 21:07:01.223377 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.223279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.226317 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.226260    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 21:07:01.226317 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.226272    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:07:01.226510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.226322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 21:07:01.226510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.226354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p74sw\""
Jul 15 21:07:01.226510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.226391    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 21:07:01.266897 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.266861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p" event={"ID":"5c50e517-86eb-4424-9c60-1054353518ea","Type":"ContainerStarted","Data":"ba5a9c986fa88092f330b93165139e0d464ed27067ecdcc70ed51f02ed615311"}
Jul 15 21:07:01.268357 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.268323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cpj54" event={"ID":"572382a0-06b2-49c3-a09c-23df0a6baea2","Type":"ContainerStarted","Data":"865b62d60966043490191d5470d6cfbf41a50768fbfdd9e5e4fc08ed177dc399"}
Jul 15 21:07:01.269867 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.269847    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/0.log"
Jul 15 21:07:01.269954 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.269881    2581 generic.go:356] "Generic (PLEG): container finished" podID="cb21e43a-08ca-42d3-9faa-903a5290ea4b" containerID="fc0227bde6d661e3fbb2f910857ba23491e7455a453c550323b5397bcc950370" exitCode=255
Jul 15 21:07:01.269954 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.269911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zmvlv" event={"ID":"cb21e43a-08ca-42d3-9faa-903a5290ea4b","Type":"ContainerDied","Data":"fc0227bde6d661e3fbb2f910857ba23491e7455a453c550323b5397bcc950370"}
Jul 15 21:07:01.270153 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.270139    2581 scope.go:117] "RemoveContainer" containerID="fc0227bde6d661e3fbb2f910857ba23491e7455a453c550323b5397bcc950370"
Jul 15 21:07:01.287120 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.287070    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p" podStartSLOduration=1.38852673 podStartE2EDuration="5.287048926s" totalImagesPullingTime="3.898522196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:01.286159433 +0000 UTC m=+41.979065476" watchObservedRunningTime="2026-07-15 21:07:01.287048926 +0000 UTC m=+41.979954949"
Jul 15 21:07:01.304102 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.304043    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cpj54" podStartSLOduration=3.21464246 podStartE2EDuration="7.304026697s" totalImagesPullingTime="4.089384237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:01.303616947 +0000 UTC m=+41.996522989" watchObservedRunningTime="2026-07-15 21:07:01.304026697 +0000 UTC m=+41.996932741"
Jul 15 21:07:01.317927 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.317896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2f031fb-02a8-4e38-b04f-29da02d06ecb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.318149 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.318128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f031fb-02a8-4e38-b04f-29da02d06ecb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.318459 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.318426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvdj\" (UniqueName: \"kubernetes.io/projected/a2f031fb-02a8-4e38-b04f-29da02d06ecb-kube-api-access-cwvdj\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.419603 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.419570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2f031fb-02a8-4e38-b04f-29da02d06ecb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.419769 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.419625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f031fb-02a8-4e38-b04f-29da02d06ecb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.419878 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.419854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvdj\" (UniqueName: \"kubernetes.io/projected/a2f031fb-02a8-4e38-b04f-29da02d06ecb-kube-api-access-cwvdj\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.420207 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.420185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2f031fb-02a8-4e38-b04f-29da02d06ecb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.422947 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.422920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2f031fb-02a8-4e38-b04f-29da02d06ecb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.428469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.428442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvdj\" (UniqueName: \"kubernetes.io/projected/a2f031fb-02a8-4e38-b04f-29da02d06ecb-kube-api-access-cwvdj\") pod \"kube-storage-version-migrator-operator-799cb7f958-vdbpr\" (UID: \"a2f031fb-02a8-4e38-b04f-29da02d06ecb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.532895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.532808    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"
Jul 15 21:07:01.661896 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:01.661859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr"]
Jul 15 21:07:01.665457 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:01.665431    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f031fb_02a8_4e38_b04f_29da02d06ecb.slice/crio-08a016e6370195b1dda9df8bd8a2399aa40f801a55350076668abd14a6a4b0ff WatchSource:0}: Error finding container 08a016e6370195b1dda9df8bd8a2399aa40f801a55350076668abd14a6a4b0ff: Status 404 returned error can't find the container with id 08a016e6370195b1dda9df8bd8a2399aa40f801a55350076668abd14a6a4b0ff
Jul 15 21:07:02.176941 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.176909    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fz8kj"]
Jul 15 21:07:02.211184 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.211152    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fz8kj"]
Jul 15 21:07:02.211632 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.211304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.213341 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.213323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 21:07:02.213504 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.213488    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 21:07:02.213687 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.213667    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zr29g\""
Jul 15 21:07:02.226053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.226030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c1794b-219c-4908-964a-e615cca6ad41-data-volume\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.226153 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.226090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.226228 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.226211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c1794b-219c-4908-964a-e615cca6ad41-crio-socket\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.226264 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.226236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.226325 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.226268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdsgv\" (UniqueName: \"kubernetes.io/projected/77c1794b-219c-4908-964a-e615cca6ad41-kube-api-access-zdsgv\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.274247 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.274202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr" event={"ID":"a2f031fb-02a8-4e38-b04f-29da02d06ecb","Type":"ContainerStarted","Data":"08a016e6370195b1dda9df8bd8a2399aa40f801a55350076668abd14a6a4b0ff"}
Jul 15 21:07:02.275797 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.275778    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/1.log"
Jul 15 21:07:02.276218 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.276203    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/0.log"
Jul 15 21:07:02.276271 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.276241    2581 generic.go:356] "Generic (PLEG): container finished" podID="cb21e43a-08ca-42d3-9faa-903a5290ea4b" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07" exitCode=255
Jul 15 21:07:02.276345 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.276325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zmvlv" event={"ID":"cb21e43a-08ca-42d3-9faa-903a5290ea4b","Type":"ContainerDied","Data":"c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"}
Jul 15 21:07:02.276382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.276374    2581 scope.go:117] "RemoveContainer" containerID="fc0227bde6d661e3fbb2f910857ba23491e7455a453c550323b5397bcc950370"
Jul 15 21:07:02.276622 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.276598    2581 scope.go:117] "RemoveContainer" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"
Jul 15 21:07:02.276876 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.276850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:02.327197 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c1794b-219c-4908-964a-e615cca6ad41-data-volume\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327361 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327588 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.327493    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:02.327588 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c1794b-219c-4908-964a-e615cca6ad41-data-volume\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327588 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.327575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:02.827551478 +0000 UTC m=+43.520457510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:02.327864 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c1794b-219c-4908-964a-e615cca6ad41-crio-socket\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327864 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327864 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdsgv\" (UniqueName: \"kubernetes.io/projected/77c1794b-219c-4908-964a-e615cca6ad41-kube-api-access-zdsgv\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.327864 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.327774    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:07:02.327864 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.327827    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:02.827808327 +0000 UTC m=+43.520714360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : configmap "kube-rbac-proxy" not found
Jul 15 21:07:02.328080 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.327947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77c1794b-219c-4908-964a-e615cca6ad41-crio-socket\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.336456 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.336433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdsgv\" (UniqueName: \"kubernetes.io/projected/77c1794b-219c-4908-964a-e615cca6ad41-kube-api-access-zdsgv\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.529834 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.529732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:02.529834 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.529791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:02.530065 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.529889    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:07:02.530065 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.529909    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:07:02.530065 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.529941    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:07:02.530065 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.529978    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.529961297 +0000 UTC m=+51.222867317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:07:02.530065 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.530002    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.529988035 +0000 UTC m=+51.222894073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:07:02.832982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.832897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.833147 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.833019    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:07:02.833147 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:02.833026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:02.833147 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.833101    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:02.833267 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.833102    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:03.833084595 +0000 UTC m=+44.525990634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : configmap "kube-rbac-proxy" not found
Jul 15 21:07:02.833267 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:02.833220    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:03.83319774 +0000 UTC m=+44.526103774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:03.208300 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.208264    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"]
Jul 15 21:07:03.228591 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.228564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"]
Jul 15 21:07:03.228960 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.228659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.231022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.230986    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:07:03.231022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.231002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 21:07:03.231022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.231002    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 21:07:03.231241 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.231032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 21:07:03.231432 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.231412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2pt59\""
Jul 15 21:07:03.237097 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.237078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e48c7ca-f292-406d-aae5-a14505b09ba0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.237183 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.237139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e48c7ca-f292-406d-aae5-a14505b09ba0-config\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.237233 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.237218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcplh\" (UniqueName: \"kubernetes.io/projected/2e48c7ca-f292-406d-aae5-a14505b09ba0-kube-api-access-xcplh\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.281306 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.281267    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/1.log"
Jul 15 21:07:03.281718 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.281692    2581 scope.go:117] "RemoveContainer" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"
Jul 15 21:07:03.281929 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:03.281905    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:03.337898 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.337856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e48c7ca-f292-406d-aae5-a14505b09ba0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.338091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.337930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e48c7ca-f292-406d-aae5-a14505b09ba0-config\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.338091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.338015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcplh\" (UniqueName: \"kubernetes.io/projected/2e48c7ca-f292-406d-aae5-a14505b09ba0-kube-api-access-xcplh\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.338564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.338540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e48c7ca-f292-406d-aae5-a14505b09ba0-config\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.340502 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.340486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e48c7ca-f292-406d-aae5-a14505b09ba0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.347688 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.347657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcplh\" (UniqueName: \"kubernetes.io/projected/2e48c7ca-f292-406d-aae5-a14505b09ba0-kube-api-access-xcplh\") pod \"service-ca-operator-7695fc6c8c-74srd\" (UID: \"2e48c7ca-f292-406d-aae5-a14505b09ba0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.538243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.538159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"
Jul 15 21:07:03.574268 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.574246    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw2nw_b878c29b-cb43-44bd-88e8-989972702c34/dns-node-resolver/0.log"
Jul 15 21:07:03.780581 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.780544    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"]
Jul 15 21:07:03.803012 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.802928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"]
Jul 15 21:07:03.803146 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.803059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"
Jul 15 21:07:03.805495 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.805461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wfwkd\""
Jul 15 21:07:03.843737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.843698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:03.843938 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.843768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlbpr\" (UniqueName: \"kubernetes.io/projected/01ea31cc-a040-40fa-8de7-da49fd85ca73-kube-api-access-rlbpr\") pod \"network-check-source-869dcfcdcd-j6r5j\" (UID: \"01ea31cc-a040-40fa-8de7-da49fd85ca73\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"
Jul 15 21:07:03.843938 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.843822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:03.843938 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:03.843871    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:03.843938 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:03.843928    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:07:03.844108 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:03.843972    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:05.843946976 +0000 UTC m=+46.536853015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:03.844108 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:03.843992    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:05.843984061 +0000 UTC m=+46.536890084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : configmap "kube-rbac-proxy" not found
Jul 15 21:07:03.944965 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.944931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlbpr\" (UniqueName: \"kubernetes.io/projected/01ea31cc-a040-40fa-8de7-da49fd85ca73-kube-api-access-rlbpr\") pod \"network-check-source-869dcfcdcd-j6r5j\" (UID: \"01ea31cc-a040-40fa-8de7-da49fd85ca73\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"
Jul 15 21:07:03.955968 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:03.955831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlbpr\" (UniqueName: \"kubernetes.io/projected/01ea31cc-a040-40fa-8de7-da49fd85ca73-kube-api-access-rlbpr\") pod \"network-check-source-869dcfcdcd-j6r5j\" (UID: \"01ea31cc-a040-40fa-8de7-da49fd85ca73\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"
Jul 15 21:07:04.045868 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.045835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:04.046021 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.045998    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:07:04.046096 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.046086    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:07:12.046066188 +0000 UTC m=+52.738972225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:07:04.114164 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.114131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"
Jul 15 21:07:04.145462 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.145424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd"]
Jul 15 21:07:04.147584 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.147554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:04.147750 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.147728    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:04.147838 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.147823    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:12.147802348 +0000 UTC m=+52.840708392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:04.148203 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:04.148178    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e48c7ca_f292_406d_aae5_a14505b09ba0.slice/crio-074f97865bee1ca37e95c0b44f7d0dbffd6b79c434929e37614a882225f0ba62 WatchSource:0}: Error finding container 074f97865bee1ca37e95c0b44f7d0dbffd6b79c434929e37614a882225f0ba62: Status 404 returned error can't find the container with id 074f97865bee1ca37e95c0b44f7d0dbffd6b79c434929e37614a882225f0ba62
Jul 15 21:07:04.248345 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.248298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:04.248683 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.248399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:04.248683 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.248420    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:12.248400579 +0000 UTC m=+52.941306622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:07:04.248683 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.248483    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:07:04.248683 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:04.248539    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:12.24852699 +0000 UTC m=+52.941433011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:07:04.251375 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.251337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j"]
Jul 15 21:07:04.284943 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.284912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd" event={"ID":"2e48c7ca-f292-406d-aae5-a14505b09ba0","Type":"ContainerStarted","Data":"074f97865bee1ca37e95c0b44f7d0dbffd6b79c434929e37614a882225f0ba62"}
Jul 15 21:07:04.364585 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:04.364506    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ea31cc_a040_40fa_8de7_da49fd85ca73.slice/crio-da1755d3137137f69a11f75f17f418d49956ea117c71ea94c7d7afd919fbeff5 WatchSource:0}: Error finding container da1755d3137137f69a11f75f17f418d49956ea117c71ea94c7d7afd919fbeff5: Status 404 returned error can't find the container with id da1755d3137137f69a11f75f17f418d49956ea117c71ea94c7d7afd919fbeff5
Jul 15 21:07:04.574683 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.574654    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xtlrx_57d855b3-769d-428f-8ed8-d4c611187e0d/node-ca/0.log"
Jul 15 21:07:04.975671 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:04.975638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cpj54_572382a0-06b2-49c3-a09c-23df0a6baea2/serve-healthcheck-canary/0.log"
Jul 15 21:07:05.291845 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.291807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr" event={"ID":"a2f031fb-02a8-4e38-b04f-29da02d06ecb","Type":"ContainerStarted","Data":"e1eebbb6154aa10b4e6fa076488fa5baa3b6f6ea79b2bf2f096afa63e2e16823"}
Jul 15 21:07:05.294275 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.294197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j" event={"ID":"01ea31cc-a040-40fa-8de7-da49fd85ca73","Type":"ContainerStarted","Data":"da1755d3137137f69a11f75f17f418d49956ea117c71ea94c7d7afd919fbeff5"}
Jul 15 21:07:05.320829 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.320751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr" podStartSLOduration=1.6026421640000001 podStartE2EDuration="4.320728018s" totalImagesPullingTime="2.718085854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:05.319810925 +0000 UTC m=+46.012716970" watchObservedRunningTime="2026-07-15 21:07:05.320728018 +0000 UTC m=+46.013634062"
Jul 15 21:07:05.863444 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.863407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:05.863653 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.863531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:05.863653 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:05.863564    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:05.863653 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:05.863617    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:07:05.863815 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:05.863656    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:09.863632609 +0000 UTC m=+50.556538649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:05.863815 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:05.863678    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:09.863667657 +0000 UTC m=+50.556573679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : configmap "kube-rbac-proxy" not found
Jul 15 21:07:05.983448 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:05.983400    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"]
Jul 15 21:07:06.014926 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.014850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"
Jul 15 21:07:06.018417 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.018272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6bvv4\""
Jul 15 21:07:06.019107 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.018929    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 21:07:06.019107 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.018937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 21:07:06.020307 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.020249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"]
Jul 15 21:07:06.065336 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.065297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpszl\" (UniqueName: \"kubernetes.io/projected/b1a5c7dc-2322-4091-b795-a0dbd54643d0-kube-api-access-mpszl\") pod \"migrator-7f59b54f6c-kz9kp\" (UID: \"b1a5c7dc-2322-4091-b795-a0dbd54643d0\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"
Jul 15 21:07:06.167016 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.166914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpszl\" (UniqueName: \"kubernetes.io/projected/b1a5c7dc-2322-4091-b795-a0dbd54643d0-kube-api-access-mpszl\") pod \"migrator-7f59b54f6c-kz9kp\" (UID: \"b1a5c7dc-2322-4091-b795-a0dbd54643d0\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"
Jul 15 21:07:06.177000 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.176964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpszl\" (UniqueName: \"kubernetes.io/projected/b1a5c7dc-2322-4091-b795-a0dbd54643d0-kube-api-access-mpszl\") pod \"migrator-7f59b54f6c-kz9kp\" (UID: \"b1a5c7dc-2322-4091-b795-a0dbd54643d0\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"
Jul 15 21:07:06.328437 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.328396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"
Jul 15 21:07:06.659152 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:06.659114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp"]
Jul 15 21:07:07.523692 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:07.523654    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:07.524196 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:07.523722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:07.524252 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:07.524206    2581 scope.go:117] "RemoveContainer" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"
Jul 15 21:07:07.524484 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:07.524435    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:07.827335 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:07.827239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a5c7dc_2322_4091_b795_a0dbd54643d0.slice/crio-8cd9105c30761bae72d56ec326fac1bbd326d95c8cc38836472bba2bd808b1db WatchSource:0}: Error finding container 8cd9105c30761bae72d56ec326fac1bbd326d95c8cc38836472bba2bd808b1db: Status 404 returned error can't find the container with id 8cd9105c30761bae72d56ec326fac1bbd326d95c8cc38836472bba2bd808b1db
Jul 15 21:07:08.307861 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:08.307826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd" event={"ID":"2e48c7ca-f292-406d-aae5-a14505b09ba0","Type":"ContainerStarted","Data":"8108b9ffb988f35fa659026d0459024de91e15e7a1dc1767bfff3383aef43664"}
Jul 15 21:07:08.309611 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:08.309580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j" event={"ID":"01ea31cc-a040-40fa-8de7-da49fd85ca73","Type":"ContainerStarted","Data":"a4564245a1ac989b55650dbaa640b4427deb58f4819122cd9b5d3702c707322a"}
Jul 15 21:07:08.310821 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:08.310793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp" event={"ID":"b1a5c7dc-2322-4091-b795-a0dbd54643d0","Type":"ContainerStarted","Data":"8cd9105c30761bae72d56ec326fac1bbd326d95c8cc38836472bba2bd808b1db"}
Jul 15 21:07:08.323746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:08.323698    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd" podStartSLOduration=1.433798172 podStartE2EDuration="5.323682379s" totalImagesPullingTime="3.889884207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:08.323345842 +0000 UTC m=+49.016251911" watchObservedRunningTime="2026-07-15 21:07:08.323682379 +0000 UTC m=+49.016588460"
Jul 15 21:07:08.339138 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:08.339083    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j6r5j" podStartSLOduration=1.6675206930000002 podStartE2EDuration="5.339066449s" totalImagesPullingTime="3.671545756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:08.338778908 +0000 UTC m=+49.031684991" watchObservedRunningTime="2026-07-15 21:07:08.339066449 +0000 UTC m=+49.031972491"
Jul 15 21:07:09.903279 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:09.903243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:09.903736 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:09.903347    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:07:09.903736 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:09.903386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:09.903736 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:09.903409    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:17.903385914 +0000 UTC m=+58.596291939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : configmap "kube-rbac-proxy" not found
Jul 15 21:07:09.903736 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:09.903470    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:09.903736 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:09.903517    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:17.903502367 +0000 UTC m=+58.596408403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:10.318984 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:10.318940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp" event={"ID":"b1a5c7dc-2322-4091-b795-a0dbd54643d0","Type":"ContainerStarted","Data":"d4244e7b681e67ec994b9788154f24d76200fad0b76110e2c869309e54288ad8"}
Jul 15 21:07:10.319175 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:10.319032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp" event={"ID":"b1a5c7dc-2322-4091-b795-a0dbd54643d0","Type":"ContainerStarted","Data":"f64280797d17f8fb634d0929f13dc15247efac9fc5935599f6b04fe247d1220e"}
Jul 15 21:07:10.335710 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:10.335657    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kz9kp" podStartSLOduration=3.672962208 podStartE2EDuration="5.335641542s" totalImagesPullingTime="1.662679334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:10.334733385 +0000 UTC m=+51.027639432" watchObservedRunningTime="2026-07-15 21:07:10.335641542 +0000 UTC m=+51.028547585"
Jul 15 21:07:10.610558 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:10.610466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:10.610558 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:10.610510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:10.610810 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:10.610656    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:07:10.610810 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:10.610689    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8d4c8c65-6xmpq: secret "image-registry-tls" not found
Jul 15 21:07:10.610810 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:10.610753    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls podName:c630575d-fd06-4323-9802-3e48dec486ae nodeName:}" failed. No retries permitted until 2026-07-15 21:07:26.610733271 +0000 UTC m=+67.303639304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls") pod "image-registry-7c8d4c8c65-6xmpq" (UID: "c630575d-fd06-4323-9802-3e48dec486ae") : secret "image-registry-tls" not found
Jul 15 21:07:10.610810 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:10.610670    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:07:10.610810 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:10.610799    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls podName:7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:26.610788255 +0000 UTC m=+67.303694275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls") pod "dns-default-q6phd" (UID: "7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d") : secret "dns-default-metrics-tls" not found
Jul 15 21:07:12.125907 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:12.125865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:12.126388 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.126010    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:07:12.126388 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.126075    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls podName:892f3989-2377-4cd3-ade4-8506e5384e1f nodeName:}" failed. No retries permitted until 2026-07-15 21:07:28.126057385 +0000 UTC m=+68.818963407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls") pod "cluster-samples-operator-65db858894-lxxlk" (UID: "892f3989-2377-4cd3-ade4-8506e5384e1f") : secret "samples-operator-tls" not found
Jul 15 21:07:12.226823 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:12.226780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:12.226997 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.226934    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:12.227037 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.227002    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls podName:43378288-071e-480b-a104-4f2550a04243 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:28.226986111 +0000 UTC m=+68.919892130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-smrhb" (UID: "43378288-071e-480b-a104-4f2550a04243") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:07:12.327551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:12.327520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:12.327840 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:12.327573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:12.327840 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.327664    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:07:12.327840 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.327719    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:28.327685896 +0000 UTC m=+69.020591915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:07:12.327840 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:12.327745    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs podName:db887899-543c-44a1-92af-f0b649be473d nodeName:}" failed. No retries permitted until 2026-07-15 21:07:28.32773489 +0000 UTC m=+69.020640910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs") pod "router-default-6547f5d7b6-qlhfc" (UID: "db887899-543c-44a1-92af-f0b649be473d") : secret "router-metrics-certs-default" not found
Jul 15 21:07:17.980559 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:17.980524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:17.981020 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:17.980626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:17.981020 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:17.980672    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:17.981020 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:17.980756    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls podName:77c1794b-219c-4908-964a-e615cca6ad41 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:33.980740083 +0000 UTC m=+74.673646103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fz8kj" (UID: "77c1794b-219c-4908-964a-e615cca6ad41") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:07:17.981157 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:17.981138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77c1794b-219c-4908-964a-e615cca6ad41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:21.237938 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:21.237907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lmw6"
Jul 15 21:07:21.996440 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:21.996405    2581 scope.go:117] "RemoveContainer" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"
Jul 15 21:07:22.357262 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.357181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:07:22.357660 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.357624    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/1.log"
Jul 15 21:07:22.357703 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.357658    2581 generic.go:356] "Generic (PLEG): container finished" podID="cb21e43a-08ca-42d3-9faa-903a5290ea4b" containerID="823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd" exitCode=255
Jul 15 21:07:22.357737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.357716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zmvlv" event={"ID":"cb21e43a-08ca-42d3-9faa-903a5290ea4b","Type":"ContainerDied","Data":"823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd"}
Jul 15 21:07:22.357797 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.357785    2581 scope.go:117] "RemoveContainer" containerID="c66384e3111d34c031fa60eec0180ddbfbc8216d6fb1ee0b5b43f4d785ee3e07"
Jul 15 21:07:22.358090 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:22.358070    2581 scope.go:117] "RemoveContainer" containerID="823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd"
Jul 15 21:07:22.358274 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:22.358248    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:23.364359 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:23.364330    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:07:25.547912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.547869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:07:25.550431 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.550408    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:07:25.560396 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.560368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c11b51b4-df9b-4eb9-be85-7b6642653077-metrics-certs\") pod \"network-metrics-daemon-zl9lr\" (UID: \"c11b51b4-df9b-4eb9-be85-7b6642653077\") " pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:07:25.648875 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.648830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:07:25.649080 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.648965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:07:25.651231 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.651209    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:07:25.651435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.651413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nfr\" (UniqueName: \"kubernetes.io/projected/6dfe684e-6716-4d47-80ba-9f77e46eba8b-kube-api-access-q8nfr\") pod \"network-check-target-t6sdk\" (UID: \"6dfe684e-6716-4d47-80ba-9f77e46eba8b\") " pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:07:25.662037 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.662015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07054f71-c3a8-4f1b-bee5-c7977c1a15ab-original-pull-secret\") pod \"global-pull-secret-syncer-qv9r5\" (UID: \"07054f71-c3a8-4f1b-bee5-c7977c1a15ab\") " pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:07:25.709781 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.709735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv9r5"
Jul 15 21:07:25.720688 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.720666    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v4wmg\""
Jul 15 21:07:25.726083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.726054    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jw9wn\""
Jul 15 21:07:25.728507 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.728485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:07:25.734363 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.734337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl9lr"
Jul 15 21:07:25.881304 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.881258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qv9r5"]
Jul 15 21:07:25.898269 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.898242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6sdk"]
Jul 15 21:07:25.901210 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:25.901185    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfe684e_6716_4d47_80ba_9f77e46eba8b.slice/crio-20de04be6b0c5cc6fcb0738ad391be8a8f617cc539d751294dd2495808dfd0ea WatchSource:0}: Error finding container 20de04be6b0c5cc6fcb0738ad391be8a8f617cc539d751294dd2495808dfd0ea: Status 404 returned error can't find the container with id 20de04be6b0c5cc6fcb0738ad391be8a8f617cc539d751294dd2495808dfd0ea
Jul 15 21:07:25.918457 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:25.918430    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zl9lr"]
Jul 15 21:07:25.928395 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:25.928363    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11b51b4_df9b_4eb9_be85_7b6642653077.slice/crio-380d6a546f43c8ab3d25e3eb166fb06b749796ee871b95f9e1df2d95d8b91043 WatchSource:0}: Error finding container 380d6a546f43c8ab3d25e3eb166fb06b749796ee871b95f9e1df2d95d8b91043: Status 404 returned error can't find the container with id 380d6a546f43c8ab3d25e3eb166fb06b749796ee871b95f9e1df2d95d8b91043
Jul 15 21:07:26.376930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.376892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl9lr" event={"ID":"c11b51b4-df9b-4eb9-be85-7b6642653077","Type":"ContainerStarted","Data":"380d6a546f43c8ab3d25e3eb166fb06b749796ee871b95f9e1df2d95d8b91043"}
Jul 15 21:07:26.378274 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.378243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qv9r5" event={"ID":"07054f71-c3a8-4f1b-bee5-c7977c1a15ab","Type":"ContainerStarted","Data":"2c07be6324acba3895f54c961741544a6ef0ca6a2f1e30f9b767e1f446e3e248"}
Jul 15 21:07:26.380012 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.379972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6sdk" event={"ID":"6dfe684e-6716-4d47-80ba-9f77e46eba8b","Type":"ContainerStarted","Data":"196b3108322e7b1e2ec99acdfa265a6b61512f9c8432b9316ce47c55c31dd0ab"}
Jul 15 21:07:26.380144 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.380026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6sdk" event={"ID":"6dfe684e-6716-4d47-80ba-9f77e46eba8b","Type":"ContainerStarted","Data":"20de04be6b0c5cc6fcb0738ad391be8a8f617cc539d751294dd2495808dfd0ea"}
Jul 15 21:07:26.380144 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.380114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:07:26.396926 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.396860    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t6sdk" podStartSLOduration=66.396844728 podStartE2EDuration="1m6.396844728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:26.395785238 +0000 UTC m=+67.088691282" watchObservedRunningTime="2026-07-15 21:07:26.396844728 +0000 UTC m=+67.089750770"
Jul 15 21:07:26.659121 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.659027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:26.659121 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.659078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:26.661849 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.661814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d-metrics-tls\") pod \"dns-default-q6phd\" (UID: \"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d\") " pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:26.661982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.661882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"image-registry-7c8d4c8c65-6xmpq\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") " pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:26.879310 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.876616    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zhpfs\""
Jul 15 21:07:26.882874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.882844    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mhzfs\""
Jul 15 21:07:26.884610 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.884556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:26.892056 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:26.892030    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:27.065379 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.065341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:07:27.069086 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:27.069057    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc630575d_fd06_4323_9802_3e48dec486ae.slice/crio-11485cfa3ac480f58c3c9cd3e2bc70f42e6ff2ebfb8deaa87ef79e1dbca937e4 WatchSource:0}: Error finding container 11485cfa3ac480f58c3c9cd3e2bc70f42e6ff2ebfb8deaa87ef79e1dbca937e4: Status 404 returned error can't find the container with id 11485cfa3ac480f58c3c9cd3e2bc70f42e6ff2ebfb8deaa87ef79e1dbca937e4
Jul 15 21:07:27.082278 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.082251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q6phd"]
Jul 15 21:07:27.085932 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:27.085894    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db3c46a_f8f5_4f8b_830a_c4c2c2fa244d.slice/crio-90d40041d02bec05849a117c45d74697f687480807c9e8aa8c814cd3019c4b24 WatchSource:0}: Error finding container 90d40041d02bec05849a117c45d74697f687480807c9e8aa8c814cd3019c4b24: Status 404 returned error can't find the container with id 90d40041d02bec05849a117c45d74697f687480807c9e8aa8c814cd3019c4b24
Jul 15 21:07:27.385847 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.385751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q6phd" event={"ID":"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d","Type":"ContainerStarted","Data":"90d40041d02bec05849a117c45d74697f687480807c9e8aa8c814cd3019c4b24"}
Jul 15 21:07:27.388129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.388097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl9lr" event={"ID":"c11b51b4-df9b-4eb9-be85-7b6642653077","Type":"ContainerStarted","Data":"9b04879ff747f7f5f154406c5fa45f214ad122a03f447b697ec48e6247cd05f9"}
Jul 15 21:07:27.388274 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.388155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl9lr" event={"ID":"c11b51b4-df9b-4eb9-be85-7b6642653077","Type":"ContainerStarted","Data":"e5ac3263ce78a8e7c028202a45afa06a3c46a43738a74839ff37e58d61d354f2"}
Jul 15 21:07:27.390147 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.390114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" event={"ID":"c630575d-fd06-4323-9802-3e48dec486ae","Type":"ContainerStarted","Data":"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"}
Jul 15 21:07:27.390275 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.390164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" event={"ID":"c630575d-fd06-4323-9802-3e48dec486ae","Type":"ContainerStarted","Data":"11485cfa3ac480f58c3c9cd3e2bc70f42e6ff2ebfb8deaa87ef79e1dbca937e4"}
Jul 15 21:07:27.390415 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.390395    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:27.408194 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.408022    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zl9lr" podStartSLOduration=66.56586188 podStartE2EDuration="1m7.407990102s" totalImagesPullingTime="842.128222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:27.407563412 +0000 UTC m=+68.100469454" watchObservedRunningTime="2026-07-15 21:07:27.407990102 +0000 UTC m=+68.100896148"
Jul 15 21:07:27.429081 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.429028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" podStartSLOduration=66.42901169 podStartE2EDuration="1m6.42901169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:27.427683329 +0000 UTC m=+68.120589370" watchObservedRunningTime="2026-07-15 21:07:27.42901169 +0000 UTC m=+68.121917732"
Jul 15 21:07:27.523900 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.523827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:27.523900 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.523903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:27.524418 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:27.524395    2581 scope.go:117] "RemoveContainer" containerID="823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd"
Jul 15 21:07:27.524624 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:27.524599    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:28.173393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.173351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:28.176456 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.176405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/892f3989-2377-4cd3-ade4-8506e5384e1f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lxxlk\" (UID: \"892f3989-2377-4cd3-ade4-8506e5384e1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:28.274653 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.274603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:28.277022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.276993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43378288-071e-480b-a104-4f2550a04243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-smrhb\" (UID: \"43378288-071e-480b-a104-4f2550a04243\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:28.376113 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.376075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:28.376338 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.376204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:28.376839 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.376812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db887899-543c-44a1-92af-f0b649be473d-service-ca-bundle\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:28.379148 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.379114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db887899-543c-44a1-92af-f0b649be473d-metrics-certs\") pod \"router-default-6547f5d7b6-qlhfc\" (UID: \"db887899-543c-44a1-92af-f0b649be473d\") " pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:28.405856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.405826    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qmt2q\""
Jul 15 21:07:28.412025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.411965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zfr7m\""
Jul 15 21:07:28.414008 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.413971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"
Jul 15 21:07:28.419980 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.419953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"
Jul 15 21:07:28.513335 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.513264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j2mp4\""
Jul 15 21:07:28.520394 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:28.520365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:29.041053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.040931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6547f5d7b6-qlhfc"]
Jul 15 21:07:29.139399 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:29.139307    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb887899_543c_44a1_92af_f0b649be473d.slice/crio-038bd52b4f6cb73ca1d5adf946c39c47b401a09c5de7a8489e59496652b381e6 WatchSource:0}: Error finding container 038bd52b4f6cb73ca1d5adf946c39c47b401a09c5de7a8489e59496652b381e6: Status 404 returned error can't find the container with id 038bd52b4f6cb73ca1d5adf946c39c47b401a09c5de7a8489e59496652b381e6
Jul 15 21:07:29.260835 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.260810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb"]
Jul 15 21:07:29.266051 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.266027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk"]
Jul 15 21:07:29.401707 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.401622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc" event={"ID":"db887899-543c-44a1-92af-f0b649be473d","Type":"ContainerStarted","Data":"c78c0a8f7f884515db4f54415659b5029ec7687f71ed453a03f4773f68772a16"}
Jul 15 21:07:29.401707 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.401683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc" event={"ID":"db887899-543c-44a1-92af-f0b649be473d","Type":"ContainerStarted","Data":"038bd52b4f6cb73ca1d5adf946c39c47b401a09c5de7a8489e59496652b381e6"}
Jul 15 21:07:29.427602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.427527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc" podStartSLOduration=33.427506998 podStartE2EDuration="33.427506998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:29.426501555 +0000 UTC m=+70.119407645" watchObservedRunningTime="2026-07-15 21:07:29.427506998 +0000 UTC m=+70.120413041"
Jul 15 21:07:29.520982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.520950    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:29.523937 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:29.523878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:30.405689 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:30.405649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:30.407079 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:30.407055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6547f5d7b6-qlhfc"
Jul 15 21:07:31.411146 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.411040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q6phd" event={"ID":"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d","Type":"ContainerStarted","Data":"47368ccce51a78b10c2039f7f0f6d0e2f6847e1ccc14424f02a887abe04bc09f"}
Jul 15 21:07:31.411146 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.411127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q6phd" event={"ID":"7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d","Type":"ContainerStarted","Data":"f74f8c06183ba6b11ba3350b3b3a23e2f7dce63c91484cc2a36294815e3c1746"}
Jul 15 21:07:31.411698 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.411201    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:31.413175 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.413142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk" event={"ID":"892f3989-2377-4cd3-ade4-8506e5384e1f","Type":"ContainerStarted","Data":"b0c8af1e2b3b5da74ae42c49a1819e34c0c979bbb5d6f8ecc3ac5070bf20dba4"}
Jul 15 21:07:31.416478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.416433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qv9r5" event={"ID":"07054f71-c3a8-4f1b-bee5-c7977c1a15ab","Type":"ContainerStarted","Data":"4dd0c2a4a6164a21a2f8e81acd3a25eafc212a2dd8e01affdfb1ab430d893991"}
Jul 15 21:07:31.417820 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.417794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb" event={"ID":"43378288-071e-480b-a104-4f2550a04243","Type":"ContainerStarted","Data":"64cefebedaeff89f244a83d341e91aa55c4e5cc6afd47ae83ab216229543451c"}
Jul 15 21:07:31.502787 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:31.502733    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q6phd" podStartSLOduration=35.425691411 podStartE2EDuration="37.502713332s" totalImagesPullingTime="2.077021921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:31.501022655 +0000 UTC m=+72.193928729" watchObservedRunningTime="2026-07-15 21:07:31.502713332 +0000 UTC m=+72.195619352"
Jul 15 21:07:33.429031 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.428992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb" event={"ID":"43378288-071e-480b-a104-4f2550a04243","Type":"ContainerStarted","Data":"ac7e62786e6904cbd76066fc587e1f3029426bbc0525f63a4b7cbc77421f98f1"}
Jul 15 21:07:33.431122 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.431086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk" event={"ID":"892f3989-2377-4cd3-ade4-8506e5384e1f","Type":"ContainerStarted","Data":"2b2b397b7626e0d6f9c89ee5615f1db8945976247beb8d3f17bedf012c9bb56f"}
Jul 15 21:07:33.431267 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.431168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk" event={"ID":"892f3989-2377-4cd3-ade4-8506e5384e1f","Type":"ContainerStarted","Data":"831c06eae1c61536be210d3e01e9dfa8d9eaef5c981893538d4bb6e9d883c204"}
Jul 15 21:07:33.450820 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.450768    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qv9r5" podStartSLOduration=67.326751488 podStartE2EDuration="1m12.450752342s" totalImagesPullingTime="5.124000854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:31.541087897 +0000 UTC m=+72.233993984" watchObservedRunningTime="2026-07-15 21:07:33.450752342 +0000 UTC m=+74.143658385"
Jul 15 21:07:33.451315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.451260    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-smrhb" podStartSLOduration=35.01898319 podStartE2EDuration="37.451249103s" totalImagesPullingTime="2.432265913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:33.449786323 +0000 UTC m=+74.142692367" watchObservedRunningTime="2026-07-15 21:07:33.451249103 +0000 UTC m=+74.144155144"
Jul 15 21:07:33.474424 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:33.474372    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lxxlk" podStartSLOduration=35.115978925 podStartE2EDuration="37.474354466s" totalImagesPullingTime="2.358375541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:33.473464217 +0000 UTC m=+74.166370316" watchObservedRunningTime="2026-07-15 21:07:33.474354466 +0000 UTC m=+74.167260498"
Jul 15 21:07:34.028496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:34.028457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:34.030804 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:34.030778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77c1794b-219c-4908-964a-e615cca6ad41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fz8kj\" (UID: \"77c1794b-219c-4908-964a-e615cca6ad41\") " pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:34.324634 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:34.324551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zr29g\""
Jul 15 21:07:34.331671 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:34.331641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fz8kj"
Jul 15 21:07:34.482820 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:34.482791    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fz8kj"]
Jul 15 21:07:34.484961 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:34.484930    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c1794b_219c_4908_964a_e615cca6ad41.slice/crio-9dde156161ac625f497087d4bc559fb5c66a3a00daeb0d663c257b6b22874f82 WatchSource:0}: Error finding container 9dde156161ac625f497087d4bc559fb5c66a3a00daeb0d663c257b6b22874f82: Status 404 returned error can't find the container with id 9dde156161ac625f497087d4bc559fb5c66a3a00daeb0d663c257b6b22874f82
Jul 15 21:07:35.443470 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:35.443427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fz8kj" event={"ID":"77c1794b-219c-4908-964a-e615cca6ad41","Type":"ContainerStarted","Data":"9dde156161ac625f497087d4bc559fb5c66a3a00daeb0d663c257b6b22874f82"}
Jul 15 21:07:40.464201 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:40.464166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fz8kj" event={"ID":"77c1794b-219c-4908-964a-e615cca6ad41","Type":"ContainerStarted","Data":"08622b39d69eec58891d919792f7fa3b8a528e2c12eab66d9d25c14fad06287b"}
Jul 15 21:07:41.424979 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:41.424856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q6phd"
Jul 15 21:07:41.996510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:41.996473    2581 scope.go:117] "RemoveContainer" containerID="823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd"
Jul 15 21:07:41.996961 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:41.996653    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zmvlv_openshift-console-operator(cb21e43a-08ca-42d3-9faa-903a5290ea4b)\"" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podUID="cb21e43a-08ca-42d3-9faa-903a5290ea4b"
Jul 15 21:07:45.488599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:45.488555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fz8kj" event={"ID":"77c1794b-219c-4908-964a-e615cca6ad41","Type":"ContainerStarted","Data":"d16b966b6312fc7aa20c774244347de1a12e678216e17ed624f06d5c581095b6"}
Jul 15 21:07:46.366633 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.366595    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mrdxc"]
Jul 15 21:07:46.369508 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.369479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.372212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.372034    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 21:07:46.372212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.372050    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6c44\""
Jul 15 21:07:46.372212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.372153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 21:07:46.372212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.372166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 21:07:46.372533 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.372473    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 21:07:46.435487 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-wtmp\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435487 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-root\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435740 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-metrics-client-ca\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435740 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-textfile\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435740 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-sys\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjf6w\" (UniqueName: \"kubernetes.io/projected/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-kube-api-access-cjf6w\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-tls\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.435874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.435859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.536727 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-textfile\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.536727 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-sys\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-sys\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf6w\" (UniqueName: \"kubernetes.io/projected/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-kube-api-access-cjf6w\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.536997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-tls\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-wtmp\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-root\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-metrics-client-ca\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-textfile\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-root\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537861 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-wtmp\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537861 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.537861 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.537789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-metrics-client-ca\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.539749 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.539723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-tls\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.539878 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.539855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.550435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.550403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjf6w\" (UniqueName: \"kubernetes.io/projected/5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4-kube-api-access-cjf6w\") pod \"node-exporter-mrdxc\" (UID: \"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4\") " pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.681752 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.681701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrdxc"
Jul 15 21:07:46.889179 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.889135    2581 patch_prober.go:28] interesting pod/image-registry-7c8d4c8c65-6xmpq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 21:07:46.889384 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:46.889199    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" podUID="c630575d-fd06-4323-9802-3e48dec486ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:07:48.220755 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:48.220709    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1cc39d_c2bf_4fc6_b6c9_c3217ae3fbe4.slice/crio-635208549c9fe6dbecc121845c3c27ce2017df652faebf3b058a1368273c924e WatchSource:0}: Error finding container 635208549c9fe6dbecc121845c3c27ce2017df652faebf3b058a1368273c924e: Status 404 returned error can't find the container with id 635208549c9fe6dbecc121845c3c27ce2017df652faebf3b058a1368273c924e
Jul 15 21:07:48.400344 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:48.400309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:07:48.504267 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:48.504164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fz8kj" event={"ID":"77c1794b-219c-4908-964a-e615cca6ad41","Type":"ContainerStarted","Data":"f65a08916a3178a875c4943ef36301aa8005b1d1fa15bb6a154b814b46b622f4"}
Jul 15 21:07:48.505455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:48.505433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrdxc" event={"ID":"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4","Type":"ContainerStarted","Data":"635208549c9fe6dbecc121845c3c27ce2017df652faebf3b058a1368273c924e"}
Jul 15 21:07:48.524566 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:48.524506    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fz8kj" podStartSLOduration=32.920094044 podStartE2EDuration="46.524487122s" totalImagesPullingTime="13.604393078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:07:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:48.524073654 +0000 UTC m=+89.216979697" watchObservedRunningTime="2026-07-15 21:07:48.524487122 +0000 UTC m=+89.217393164"
Jul 15 21:07:49.463532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.463470    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"]
Jul 15 21:07:49.467017 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.466997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.469535 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.469510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 21:07:49.469696 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.469509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n4d5m\""
Jul 15 21:07:49.469696 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.469512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 21:07:49.469818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.469791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 21:07:49.469818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.469797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 21:07:49.470063 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.470044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8qsk6eubuo3bq\""
Jul 15 21:07:49.470137 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.470080    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 21:07:49.481937 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.481918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"]
Jul 15 21:07:49.510393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.510361    2581 generic.go:356] "Generic (PLEG): container finished" podID="5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4" containerID="db62c89e60a9814a2b5e1d0d60b7acf95377bab1d92b52a6baadd15878fdf366" exitCode=0
Jul 15 21:07:49.510527 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.510454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrdxc" event={"ID":"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4","Type":"ContainerDied","Data":"db62c89e60a9814a2b5e1d0d60b7acf95377bab1d92b52a6baadd15878fdf366"}
Jul 15 21:07:49.566850 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.566821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380ffa19-a639-4c56-84e3-4ee5a00b39a6-metrics-client-ca\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.566957 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.566873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567032 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.566979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-grpc-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567099 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.567076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.567116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtnzt\" (UniqueName: \"kubernetes.io/projected/380ffa19-a639-4c56-84e3-4ee5a00b39a6-kube-api-access-xtnzt\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567217 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.567200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567273 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.567234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.567273 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.567255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.667842 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.667842 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380ffa19-a639-4c56-84e3-4ee5a00b39a6-metrics-client-ca\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-grpc-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.667997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtnzt\" (UniqueName: \"kubernetes.io/projected/380ffa19-a639-4c56-84e3-4ee5a00b39a6-kube-api-access-xtnzt\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668096 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.668028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.668776 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.668747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380ffa19-a639-4c56-84e3-4ee5a00b39a6-metrics-client-ca\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.670696 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.670650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.670811 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.670787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.671016 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.670992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.671091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.671016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.671091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.671041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-grpc-tls\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.671091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.671051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/380ffa19-a639-4c56-84e3-4ee5a00b39a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.677349 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.677327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtnzt\" (UniqueName: \"kubernetes.io/projected/380ffa19-a639-4c56-84e3-4ee5a00b39a6-kube-api-access-xtnzt\") pod \"thanos-querier-5d8779b9b4-c2hhz\" (UID: \"380ffa19-a639-4c56-84e3-4ee5a00b39a6\") " pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.777383 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.777270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:49.919192 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:49.919144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"]
Jul 15 21:07:49.923374 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:49.923345    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380ffa19_a639_4c56_84e3_4ee5a00b39a6.slice/crio-80cdd9d6537ed33815a75b7f91665c0e861be72e768339c83e3275544aab4886 WatchSource:0}: Error finding container 80cdd9d6537ed33815a75b7f91665c0e861be72e768339c83e3275544aab4886: Status 404 returned error can't find the container with id 80cdd9d6537ed33815a75b7f91665c0e861be72e768339c83e3275544aab4886
Jul 15 21:07:50.517822 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.517770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrdxc" event={"ID":"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4","Type":"ContainerStarted","Data":"47e14f4850622e0d02e9a9df417571a5a0bfe53733747031608ebdc79e462eb9"}
Jul 15 21:07:50.518432 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.517876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrdxc" event={"ID":"5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4","Type":"ContainerStarted","Data":"ef8bdd1d4a7603959274cf48a624fd1a62563f59e620bc79a32de29e064a8d22"}
Jul 15 21:07:50.519635 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.519600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"80cdd9d6537ed33815a75b7f91665c0e861be72e768339c83e3275544aab4886"}
Jul 15 21:07:50.538853 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.538792    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mrdxc" podStartSLOduration=3.608001623 podStartE2EDuration="4.538765728s" totalImagesPullingTime="863.819092ms" totalInitContainerRuntime="66.945013ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:50.53845675 +0000 UTC m=+91.231362836" watchObservedRunningTime="2026-07-15 21:07:50.538765728 +0000 UTC m=+91.231671771"
Jul 15 21:07:50.675258 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.675217    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84c79f7c68-nljwd"]
Jul 15 21:07:50.678337 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.678313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.680795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.680761    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 21:07:50.680916 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.680833    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qtjjv\""
Jul 15 21:07:50.680916 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.680901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-209m74p75q5a1\""
Jul 15 21:07:50.681024 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.680915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 21:07:50.681024 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.680770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 21:07:50.681218 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.681194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 21:07:50.689799 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.689773    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84c79f7c68-nljwd"]
Jul 15 21:07:50.776857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.776765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-tls\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.776857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.776837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-client-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.777083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.776905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-metrics-server-audit-profiles\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.777083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.776993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f01d1428-9b5c-4529-9368-4406a3b4b38c-audit-log\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.777083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.777026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-client-certs\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.777083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.777062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.777251 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.777103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxqm\" (UniqueName: \"kubernetes.io/projected/f01d1428-9b5c-4529-9368-4406a3b4b38c-kube-api-access-9jxqm\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.877874 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.877831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f01d1428-9b5c-4529-9368-4406a3b4b38c-audit-log\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.877888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-client-certs\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.877925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.877949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxqm\" (UniqueName: \"kubernetes.io/projected/f01d1428-9b5c-4529-9368-4406a3b4b38c-kube-api-access-9jxqm\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.877989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-tls\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.878044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-client-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878271 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.878069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-metrics-server-audit-profiles\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.878371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f01d1428-9b5c-4529-9368-4406a3b4b38c-audit-log\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.878796 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.878743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.879018 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.878998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f01d1428-9b5c-4529-9368-4406a3b4b38c-metrics-server-audit-profiles\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.880929 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.880904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-client-certs\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.881515 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.881490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-secret-metrics-server-tls\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.881619 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.881532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01d1428-9b5c-4529-9368-4406a3b4b38c-client-ca-bundle\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.888239 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.888211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxqm\" (UniqueName: \"kubernetes.io/projected/f01d1428-9b5c-4529-9368-4406a3b4b38c-kube-api-access-9jxqm\") pod \"metrics-server-84c79f7c68-nljwd\" (UID: \"f01d1428-9b5c-4529-9368-4406a3b4b38c\") " pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:50.990491 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:50.990453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:07:51.127802 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.127772    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"]
Jul 15 21:07:51.132221 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.132198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.134222 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.134196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 21:07:51.134364 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.134227    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9c5fs\""
Jul 15 21:07:51.140062 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.140006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"]
Jul 15 21:07:51.147838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.147810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84c79f7c68-nljwd"]
Jul 15 21:07:51.151768 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:51.151743    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01d1428_9b5c_4529_9368_4406a3b4b38c.slice/crio-eeb4260950cf50579515d74fc2e357e3c49b4b98d63da3f6f39f7626d7f167c1 WatchSource:0}: Error finding container eeb4260950cf50579515d74fc2e357e3c49b4b98d63da3f6f39f7626d7f167c1: Status 404 returned error can't find the container with id eeb4260950cf50579515d74fc2e357e3c49b4b98d63da3f6f39f7626d7f167c1
Jul 15 21:07:51.180121 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.180066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.180302 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.180178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz2qk\" (UniqueName: \"kubernetes.io/projected/daab27e2-cc06-411a-b9eb-9a864e7b33a0-kube-api-access-nz2qk\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.281602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.281555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.281829 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.281645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz2qk\" (UniqueName: \"kubernetes.io/projected/daab27e2-cc06-411a-b9eb-9a864e7b33a0-kube-api-access-nz2qk\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.281829 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:51.281734    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 21:07:51.281829 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:07:51.281820    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert podName:daab27e2-cc06-411a-b9eb-9a864e7b33a0 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:51.781797246 +0000 UTC m=+92.474703269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-6p95x" (UID: "daab27e2-cc06-411a-b9eb-9a864e7b33a0") : secret "monitoring-plugin-cert" not found
Jul 15 21:07:51.291026 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.290986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz2qk\" (UniqueName: \"kubernetes.io/projected/daab27e2-cc06-411a-b9eb-9a864e7b33a0-kube-api-access-nz2qk\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.525897 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.525838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd" event={"ID":"f01d1428-9b5c-4529-9368-4406a3b4b38c","Type":"ContainerStarted","Data":"eeb4260950cf50579515d74fc2e357e3c49b4b98d63da3f6f39f7626d7f167c1"}
Jul 15 21:07:51.786574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.786465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:51.788937 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:51.788914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daab27e2-cc06-411a-b9eb-9a864e7b33a0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6p95x\" (UID: \"daab27e2-cc06-411a-b9eb-9a864e7b33a0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:52.043237 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.043147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:52.196336 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.196277    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"]
Jul 15 21:07:52.532971 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.532931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"b8fd25938f9487468976322bce42d722f70cb5add80a569e6becca011a84554f"}
Jul 15 21:07:52.533475 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.533065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"2aeb486d08992635218e640a51ae5abeeb7c7e61450eae5a79a74c9408667ba4"}
Jul 15 21:07:52.533475 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.533119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"ae6d661ed62e4ab13f8f1a0772a1b250e47cd3e6d62c45476476d1ff5ee9c557"}
Jul 15 21:07:52.534401 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.534365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x" event={"ID":"daab27e2-cc06-411a-b9eb-9a864e7b33a0","Type":"ContainerStarted","Data":"27872dc7a4598dd311d94626c22e6c80d8405085b3b8901b6d9df9d0b6c5237c"}
Jul 15 21:07:52.997104 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:52.997073    2581 scope.go:117] "RemoveContainer" containerID="823ae3f64775734b116d79f3038834e2e13e6a9686bc4e7c768e5bbd6f6f45dd"
Jul 15 21:07:53.543498 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.543373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"068182f97b7a28d68b4035d758bd5f6b37dc16deb87212ead7a5c335ce41e93a"}
Jul 15 21:07:53.546451 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.546393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:07:53.546553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.546517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zmvlv" event={"ID":"cb21e43a-08ca-42d3-9faa-903a5290ea4b","Type":"ContainerStarted","Data":"de8ab2e380bd02e1a9603269785f6b125e376c672885be05efa04bd8bf5cffa1"}
Jul 15 21:07:53.547001 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.546982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:53.549796 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.549774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd" event={"ID":"f01d1428-9b5c-4529-9368-4406a3b4b38c","Type":"ContainerStarted","Data":"4600dd5ce3c714e367ecda8cc3c6794e7acbdfe131a03849cc230c132ec5c184"}
Jul 15 21:07:53.571483 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.571438    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-zmvlv" podStartSLOduration=53.462505205 podStartE2EDuration="56.571420858s" totalImagesPullingTime="3.108915653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:53.569740733 +0000 UTC m=+94.262646777" watchObservedRunningTime="2026-07-15 21:07:53.571420858 +0000 UTC m=+94.264326901"
Jul 15 21:07:53.591558 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.591516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd" podStartSLOduration=2.060087333 podStartE2EDuration="3.591499535s" totalImagesPullingTime="1.531412202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:53.590631318 +0000 UTC m=+94.283537387" watchObservedRunningTime="2026-07-15 21:07:53.591499535 +0000 UTC m=+94.284405577"
Jul 15 21:07:53.683984 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.683941    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:07:53.974900 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:53.974868    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-zmvlv"
Jul 15 21:07:54.175227 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.175188    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-vfmh4"]
Jul 15 21:07:54.182409 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.182376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:07:54.185391 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.185368    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cjvp8\""
Jul 15 21:07:54.185533 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.185394    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 21:07:54.185533 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.185406    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 21:07:54.190624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.190601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vfmh4"]
Jul 15 21:07:54.309332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.309215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pztf4\" (UniqueName: \"kubernetes.io/projected/0c6ff558-19ac-4263-8e7c-508e3bf837f8-kube-api-access-pztf4\") pod \"downloads-68c9cbb497-vfmh4\" (UID: \"0c6ff558-19ac-4263-8e7c-508e3bf837f8\") " pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:07:54.409673 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.409634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pztf4\" (UniqueName: \"kubernetes.io/projected/0c6ff558-19ac-4263-8e7c-508e3bf837f8-kube-api-access-pztf4\") pod \"downloads-68c9cbb497-vfmh4\" (UID: \"0c6ff558-19ac-4263-8e7c-508e3bf837f8\") " pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:07:54.419011 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.418983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pztf4\" (UniqueName: \"kubernetes.io/projected/0c6ff558-19ac-4263-8e7c-508e3bf837f8-kube-api-access-pztf4\") pod \"downloads-68c9cbb497-vfmh4\" (UID: \"0c6ff558-19ac-4263-8e7c-508e3bf837f8\") " pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:07:54.492927 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.492890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:07:54.558711 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.558670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"7c4341f7d5697c03f2b045a37e6710130706d31bbde55a761378c66c5aa29773"}
Jul 15 21:07:54.559159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.558758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" event={"ID":"380ffa19-a639-4c56-84e3-4ee5a00b39a6","Type":"ContainerStarted","Data":"8399d1bd4495066eb74633435fe4550b1853a28f8a33333138b4e99eaff9288c"}
Jul 15 21:07:54.559159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.558869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:07:54.560752 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.560644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x" event={"ID":"daab27e2-cc06-411a-b9eb-9a864e7b33a0","Type":"ContainerStarted","Data":"85d2b0a7f1ed0f4730b9fa23cc46fadd64772479017100b78871179ed6474f69"}
Jul 15 21:07:54.561048 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.561000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:54.565455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.565435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x"
Jul 15 21:07:54.582527 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.582461    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz" podStartSLOduration=2.643706013 podStartE2EDuration="5.582439861s" totalImagesPullingTime="2.938733848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:54.580998667 +0000 UTC m=+95.273904738" watchObservedRunningTime="2026-07-15 21:07:54.582439861 +0000 UTC m=+95.275345908"
Jul 15 21:07:54.599179 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.598952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6p95x" podStartSLOduration=2.283182278 podStartE2EDuration="3.598933124s" totalImagesPullingTime="1.315750846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:54.597206701 +0000 UTC m=+95.290112767" watchObservedRunningTime="2026-07-15 21:07:54.598933124 +0000 UTC m=+95.291839197"
Jul 15 21:07:54.630941 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:54.630908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vfmh4"]
Jul 15 21:07:54.635457 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:07:54.635420    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6ff558_19ac_4263_8e7c_508e3bf837f8.slice/crio-dd7875f6de1a4f29ead5c5a634d83c268df0df944d059b26a78bbbdfba286e9a WatchSource:0}: Error finding container dd7875f6de1a4f29ead5c5a634d83c268df0df944d059b26a78bbbdfba286e9a: Status 404 returned error can't find the container with id dd7875f6de1a4f29ead5c5a634d83c268df0df944d059b26a78bbbdfba286e9a
Jul 15 21:07:55.565705 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:55.565658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vfmh4" event={"ID":"0c6ff558-19ac-4263-8e7c-508e3bf837f8","Type":"ContainerStarted","Data":"dd7875f6de1a4f29ead5c5a634d83c268df0df944d059b26a78bbbdfba286e9a"}
Jul 15 21:07:57.392794 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:57.392759    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t6sdk"
Jul 15 21:07:59.886993 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.886952    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:07:59.892450 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.892425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.894672 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.894647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 21:07:59.894672 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.894655    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 21:07:59.895135 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.895121    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 21:07:59.895176 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.895124    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lbxz\""
Jul 15 21:07:59.895176 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.895127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 21:07:59.895467 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.895452    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 21:07:59.902731 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.902709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:07:59.955686 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.955856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.955856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.955856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.955856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:07:59.956010 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:07:59.955872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8p5d\" (UniqueName: \"kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.056788 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.056956 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.056956 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.056956 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.056956 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8p5d\" (UniqueName: \"kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.057200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.056999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.057574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.057543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.058080 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.058040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.058080 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.058065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.060346 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.060321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.060452 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.060324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.067709 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.067674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8p5d\" (UniqueName: \"kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d\") pod \"console-6f44bb8885-cmfmf\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") " pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.202654 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.202619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:00.359162 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.359131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:08:00.362596 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:08:00.362558    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3e9a6c_5c65_46d4_928d_fd28bb1fe756.slice/crio-2bbdb5e3820e3512860c557fb1250fe02ac444bbec03866154cd72e2bf56615a WatchSource:0}: Error finding container 2bbdb5e3820e3512860c557fb1250fe02ac444bbec03866154cd72e2bf56615a: Status 404 returned error can't find the container with id 2bbdb5e3820e3512860c557fb1250fe02ac444bbec03866154cd72e2bf56615a
Jul 15 21:08:00.572576 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.572498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d8779b9b4-c2hhz"
Jul 15 21:08:00.592768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:00.592730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f44bb8885-cmfmf" event={"ID":"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756","Type":"ContainerStarted","Data":"2bbdb5e3820e3512860c557fb1250fe02ac444bbec03866154cd72e2bf56615a"}
Jul 15 21:08:04.616467 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:04.616422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f44bb8885-cmfmf" event={"ID":"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756","Type":"ContainerStarted","Data":"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"}
Jul 15 21:08:04.637295 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:04.637245    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f44bb8885-cmfmf" podStartSLOduration=1.8368022019999999 podStartE2EDuration="5.637226169s" totalImagesPullingTime="3.800423967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:04.636187739 +0000 UTC m=+105.329093772" watchObservedRunningTime="2026-07-15 21:08:04.637226169 +0000 UTC m=+105.330132212"
Jul 15 21:08:10.203166 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.203122    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:10.203736 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.203190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:10.208704 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.208676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:10.655200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.655117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:10.991039 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.991002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:08:10.991246 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:10.991078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:08:14.671236 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.671183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vfmh4" event={"ID":"0c6ff558-19ac-4263-8e7c-508e3bf837f8","Type":"ContainerStarted","Data":"fe6421fbeb3a43ecab133a797457dec1bdf8d740ec9926c20b61b8ee4ff82eb5"}
Jul 15 21:08:14.671782 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.671483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:08:14.674351 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.673914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p" event={"ID":"5c50e517-86eb-4424-9c60-1054353518ea","Type":"ContainerDied","Data":"ba5a9c986fa88092f330b93165139e0d464ed27067ecdcc70ed51f02ed615311"}
Jul 15 21:08:14.674351 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.674259    2581 scope.go:117] "RemoveContainer" containerID="ba5a9c986fa88092f330b93165139e0d464ed27067ecdcc70ed51f02ed615311"
Jul 15 21:08:14.674351 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.674343    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c50e517-86eb-4424-9c60-1054353518ea" containerID="ba5a9c986fa88092f330b93165139e0d464ed27067ecdcc70ed51f02ed615311" exitCode=0
Jul 15 21:08:14.676416 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.676394    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2f031fb-02a8-4e38-b04f-29da02d06ecb" containerID="e1eebbb6154aa10b4e6fa076488fa5baa3b6f6ea79b2bf2f096afa63e2e16823" exitCode=0
Jul 15 21:08:14.676532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.676489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr" event={"ID":"a2f031fb-02a8-4e38-b04f-29da02d06ecb","Type":"ContainerDied","Data":"e1eebbb6154aa10b4e6fa076488fa5baa3b6f6ea79b2bf2f096afa63e2e16823"}
Jul 15 21:08:14.676832 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.676814    2581 scope.go:117] "RemoveContainer" containerID="e1eebbb6154aa10b4e6fa076488fa5baa3b6f6ea79b2bf2f096afa63e2e16823"
Jul 15 21:08:14.681852 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.681830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-vfmh4"
Jul 15 21:08:14.715713 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:14.715655    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-vfmh4" podStartSLOduration=1.355461937 podStartE2EDuration="20.715633693s" totalImagesPullingTime="19.360171756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:14.695131919 +0000 UTC m=+115.388037988" watchObservedRunningTime="2026-07-15 21:08:14.715633693 +0000 UTC m=+115.408539734"
Jul 15 21:08:15.684265 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:15.684214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jsl4p" event={"ID":"5c50e517-86eb-4424-9c60-1054353518ea","Type":"ContainerStarted","Data":"19dc33f75acea0885d83a22fd23d6c4bcc2f64a5ccb40c5d80aa7583e803c535"}
Jul 15 21:08:15.687194 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:15.687159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vdbpr" event={"ID":"a2f031fb-02a8-4e38-b04f-29da02d06ecb","Type":"ContainerStarted","Data":"679dcd8deae615a40444e08c1e7568e33bbdae48f24c9fafa8ab380f6c14b524"}
Jul 15 21:08:18.711785 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:18.711715    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" podUID="c630575d-fd06-4323-9802-3e48dec486ae" containerName="registry" containerID="cri-o://533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90" gracePeriod=30
Jul 15 21:08:19.009128 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.009090    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:08:19.141872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.141835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsfgx\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.141892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.141953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.141991    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142024    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142367 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142113    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142367 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142147    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") pod \"c630575d-fd06-4323-9802-3e48dec486ae\" (UID: \"c630575d-fd06-4323-9802-3e48dec486ae\") "
Jul 15 21:08:19.142475 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142403    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:08:19.142657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.142555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:08:19.145185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.145143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:08:19.145367 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.145207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx" (OuterVolumeSpecName: "kube-api-access-dsfgx") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "kube-api-access-dsfgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:08:19.145522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.145499    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:08:19.146011 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.145974    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:08:19.146090 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.146066    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:08:19.153673 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.153643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c630575d-fd06-4323-9802-3e48dec486ae" (UID: "c630575d-fd06-4323-9802-3e48dec486ae"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243051    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-trusted-ca\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243078    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c630575d-fd06-4323-9802-3e48dec486ae-ca-trust-extracted\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243091    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c630575d-fd06-4323-9802-3e48dec486ae-registry-certificates\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243106    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-image-registry-private-configuration\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243120    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c630575d-fd06-4323-9802-3e48dec486ae-installation-pull-secrets\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243126 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243130    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-registry-tls\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243454 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243139    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsfgx\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-kube-api-access-dsfgx\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.243454 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.243147    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c630575d-fd06-4323-9802-3e48dec486ae-bound-sa-token\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:19.708053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.708014    2581 generic.go:356] "Generic (PLEG): container finished" podID="c630575d-fd06-4323-9802-3e48dec486ae" containerID="533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90" exitCode=0
Jul 15 21:08:19.708259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.708084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" event={"ID":"c630575d-fd06-4323-9802-3e48dec486ae","Type":"ContainerDied","Data":"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"}
Jul 15 21:08:19.708259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.708136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq" event={"ID":"c630575d-fd06-4323-9802-3e48dec486ae","Type":"ContainerDied","Data":"11485cfa3ac480f58c3c9cd3e2bc70f42e6ff2ebfb8deaa87ef79e1dbca937e4"}
Jul 15 21:08:19.708259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.708163    2581 scope.go:117] "RemoveContainer" containerID="533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"
Jul 15 21:08:19.708259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.708087    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"
Jul 15 21:08:19.719083 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.718816    2581 scope.go:117] "RemoveContainer" containerID="533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"
Jul 15 21:08:19.719528 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:08:19.719505    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90\": container with ID starting with 533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90 not found: ID does not exist" containerID="533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"
Jul 15 21:08:19.719590 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.719537    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90"} err="failed to get container status \"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90\": rpc error: code = NotFound desc = could not find container \"533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90\": container with ID starting with 533928d0cae509efab3f593c7eadbf1ffb9ab254f17568eb00ef329a8ed08a90 not found: ID does not exist"
Jul 15 21:08:19.734492 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.734464    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:08:19.739769 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:19.739741    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c8d4c8c65-6xmpq"]
Jul 15 21:08:20.003265 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:20.003187    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c630575d-fd06-4323-9802-3e48dec486ae" path="/var/lib/kubelet/pods/c630575d-fd06-4323-9802-3e48dec486ae/volumes"
Jul 15 21:08:21.918588 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:21.918547    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:08:30.996753 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:30.996722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:08:31.000603 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:31.000578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84c79f7c68-nljwd"
Jul 15 21:08:34.775012 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:34.774977    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e48c7ca-f292-406d-aae5-a14505b09ba0" containerID="8108b9ffb988f35fa659026d0459024de91e15e7a1dc1767bfff3383aef43664" exitCode=0
Jul 15 21:08:34.775413 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:34.775049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd" event={"ID":"2e48c7ca-f292-406d-aae5-a14505b09ba0","Type":"ContainerDied","Data":"8108b9ffb988f35fa659026d0459024de91e15e7a1dc1767bfff3383aef43664"}
Jul 15 21:08:34.775455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:34.775412    2581 scope.go:117] "RemoveContainer" containerID="8108b9ffb988f35fa659026d0459024de91e15e7a1dc1767bfff3383aef43664"
Jul 15 21:08:35.780806 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:35.780772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-74srd" event={"ID":"2e48c7ca-f292-406d-aae5-a14505b09ba0","Type":"ContainerStarted","Data":"65e01ef66f234dfee980f5ff5fcfa5eb02e163ffc8bd617a0c86d9045af74bcf"}
Jul 15 21:08:46.948366 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:46.948271    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f44bb8885-cmfmf" podUID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" containerName="console" containerID="cri-o://31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679" gracePeriod=15
Jul 15 21:08:47.231622 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.231563    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:47.258687 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8p5d\" (UniqueName: \"kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.258812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258701    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.258812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.258812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.258974 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.258974 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.258867    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config\") pod \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\" (UID: \"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756\") "
Jul 15 21:08:47.259231 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.259202    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:08:47.259360 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.259247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:08:47.259360 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.259340    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config" (OuterVolumeSpecName: "console-config") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:08:47.261163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.261135    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:08:47.261349 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.261315    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:08:47.261349 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.261318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d" (OuterVolumeSpecName: "kube-api-access-z8p5d") pod "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" (UID: "4d3e9a6c-5c65-46d4-928d-fd28bb1fe756"). InnerVolumeSpecName "kube-api-access-z8p5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:08:47.360029 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360007    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-config\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.360029 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360028    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-oauth-config\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.360193 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360039    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8p5d\" (UniqueName: \"kubernetes.io/projected/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-kube-api-access-z8p5d\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.360193 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360048    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-console-serving-cert\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.360193 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360057    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-oauth-serving-cert\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.360193 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.360065    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756-service-ca\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:08:47.830745 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.830712    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" containerID="31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679" exitCode=0
Jul 15 21:08:47.830895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.830755    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f44bb8885-cmfmf"
Jul 15 21:08:47.830895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.830768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f44bb8885-cmfmf" event={"ID":"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756","Type":"ContainerDied","Data":"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"}
Jul 15 21:08:47.830895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.830809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f44bb8885-cmfmf" event={"ID":"4d3e9a6c-5c65-46d4-928d-fd28bb1fe756","Type":"ContainerDied","Data":"2bbdb5e3820e3512860c557fb1250fe02ac444bbec03866154cd72e2bf56615a"}
Jul 15 21:08:47.830895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.830828    2581 scope.go:117] "RemoveContainer" containerID="31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"
Jul 15 21:08:47.839594 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.839577    2581 scope.go:117] "RemoveContainer" containerID="31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"
Jul 15 21:08:47.839869 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:08:47.839849    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679\": container with ID starting with 31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679 not found: ID does not exist" containerID="31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"
Jul 15 21:08:47.839915 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.839877    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679"} err="failed to get container status \"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679\": rpc error: code = NotFound desc = could not find container \"31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679\": container with ID starting with 31b9f6b2f83cbcddc07ec483362fc0064fdc95dbd4cd0d57638b2e4d56c03679 not found: ID does not exist"
Jul 15 21:08:47.852935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.852915    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:08:47.857750 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:47.857729    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f44bb8885-cmfmf"]
Jul 15 21:08:48.001373 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:08:48.001345    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" path="/var/lib/kubelet/pods/4d3e9a6c-5c65-46d4-928d-fd28bb1fe756/volumes"
Jul 15 21:11:19.780926 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:19.780897    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:11:19.780926 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:19.780915    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:11:19.784518 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:19.784497    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:11:19.784518 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:19.784509    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:11:19.791478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:19.791459    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 21:11:21.021273 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"]
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021576    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c630575d-fd06-4323-9802-3e48dec486ae" containerName="registry"
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021587    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c630575d-fd06-4323-9802-3e48dec486ae" containerName="registry"
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021607    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" containerName="console"
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021613    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" containerName="console"
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021665    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c630575d-fd06-4323-9802-3e48dec486ae" containerName="registry"
Jul 15 21:11:21.022699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.021675    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3e9a6c-5c65-46d4-928d-fd28bb1fe756" containerName="console"
Jul 15 21:11:21.023518 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.023501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.025716 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.025697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 21:11:21.026246 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.026230    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 21:11:21.026365 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.026257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4zcp8\""
Jul 15 21:11:21.033503 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.033483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"]
Jul 15 21:11:21.165876 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.165852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.165972 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.165882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.165972 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.165902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5m8\" (UniqueName: \"kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.266412 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.266386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.266494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.266417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5m8\" (UniqueName: \"kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.266494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.266488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.266808 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.266791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.266844 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.266806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.280682 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.280628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5m8\" (UniqueName: \"kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.332580 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.332560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:21.466644 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.466613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"]
Jul 15 21:11:21.470902 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:11:21.470873    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f418b9_7e4b_4ec7_bed2_3d9ce8c16f8d.slice/crio-21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242 WatchSource:0}: Error finding container 21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242: Status 404 returned error can't find the container with id 21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242
Jul 15 21:11:21.472796 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:21.472780    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:11:22.425681 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:22.425639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerStarted","Data":"21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242"}
Jul 15 21:11:27.450446 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:27.450404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerStarted","Data":"85ec7e1fcf256db5c62bc820d4fa8dcc19b00ac377717c3719c6c41d6e641643"}
Jul 15 21:11:28.455524 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:28.455488    2581 generic.go:356] "Generic (PLEG): container finished" podID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerID="85ec7e1fcf256db5c62bc820d4fa8dcc19b00ac377717c3719c6c41d6e641643" exitCode=0
Jul 15 21:11:28.455897 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:28.455542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerDied","Data":"85ec7e1fcf256db5c62bc820d4fa8dcc19b00ac377717c3719c6c41d6e641643"}
Jul 15 21:11:31.471150 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:31.471114    2581 generic.go:356] "Generic (PLEG): container finished" podID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerID="08c4c30b622bc7138f971a997f0ea1b8c9870881fa10b94b293ae564bb5d35a2" exitCode=0
Jul 15 21:11:31.471551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:31.471205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerDied","Data":"08c4c30b622bc7138f971a997f0ea1b8c9870881fa10b94b293ae564bb5d35a2"}
Jul 15 21:11:38.510597 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:38.510561    2581 generic.go:356] "Generic (PLEG): container finished" podID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerID="84c7844cc893a6ca45ab7f731dc8efac950096fde0a478f28ecf5e125141d91d" exitCode=0
Jul 15 21:11:38.510956 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:38.510649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerDied","Data":"84c7844cc893a6ca45ab7f731dc8efac950096fde0a478f28ecf5e125141d91d"}
Jul 15 21:11:39.642055 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.642030    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:39.817556 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.817471    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util\") pod \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") "
Jul 15 21:11:39.817556 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.817517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq5m8\" (UniqueName: \"kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8\") pod \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") "
Jul 15 21:11:39.817773 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.817577    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle\") pod \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\" (UID: \"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d\") "
Jul 15 21:11:39.818381 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.818354    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle" (OuterVolumeSpecName: "bundle") pod "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" (UID: "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:11:39.819703 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.819676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8" (OuterVolumeSpecName: "kube-api-access-sq5m8") pod "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" (UID: "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d"). InnerVolumeSpecName "kube-api-access-sq5m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:39.822804 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.822780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util" (OuterVolumeSpecName: "util") pod "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" (UID: "91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:11:39.918795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.918746    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq5m8\" (UniqueName: \"kubernetes.io/projected/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-kube-api-access-sq5m8\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:11:39.918795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.918789    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:11:39.918795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:39.918799    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:11:40.519896 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:40.519866    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z"
Jul 15 21:11:40.519896 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:40.519876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gq8z" event={"ID":"91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d","Type":"ContainerDied","Data":"21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242"}
Jul 15 21:11:40.520113 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:40.519918    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21a723f4f68c65ed3a19ba1e279cb0eb98fc9405846e8e60aaa7b29b90eba242"
Jul 15 21:11:50.941553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941522    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"]
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941870    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="pull"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941881    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="pull"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941888    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="extract"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941894    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="extract"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941914    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="util"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941919    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="util"
Jul 15 21:11:50.942025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.941974    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f418b9-7e4b-4ec7-bed2-3d9ce8c16f8d" containerName="extract"
Jul 15 21:11:50.946464 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.946445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:50.948648 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.948622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 21:11:50.948788 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.948690    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 21:11:50.948788 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.948692    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ndg9n\""
Jul 15 21:11:50.955315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.955278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"]
Jul 15 21:11:50.994935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.994907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctlqt\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-kube-api-access-ctlqt\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:50.995074 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:50.994967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.096160 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.096127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.096328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.096206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctlqt\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-kube-api-access-ctlqt\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.105477 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.105452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.105626 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.105607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctlqt\" (UniqueName: \"kubernetes.io/projected/2d038801-2ea1-44a8-9071-9fc835b9d133-kube-api-access-ctlqt\") pod \"cert-manager-cainjector-559cdd8c87-t4kms\" (UID: \"2d038801-2ea1-44a8-9071-9fc835b9d133\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.268964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.268887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"
Jul 15 21:11:51.396968 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.396937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t4kms"]
Jul 15 21:11:51.400839 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:11:51.400814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d038801_2ea1_44a8_9071_9fc835b9d133.slice/crio-0340c10b46c9889c9851d8e77e73624c78e246781ae70e2ddd3e8cecb83434cc WatchSource:0}: Error finding container 0340c10b46c9889c9851d8e77e73624c78e246781ae70e2ddd3e8cecb83434cc: Status 404 returned error can't find the container with id 0340c10b46c9889c9851d8e77e73624c78e246781ae70e2ddd3e8cecb83434cc
Jul 15 21:11:51.569465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:51.569385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms" event={"ID":"2d038801-2ea1-44a8-9071-9fc835b9d133","Type":"ContainerStarted","Data":"0340c10b46c9889c9851d8e77e73624c78e246781ae70e2ddd3e8cecb83434cc"}
Jul 15 21:11:54.586210 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:54.586172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms" event={"ID":"2d038801-2ea1-44a8-9071-9fc835b9d133","Type":"ContainerStarted","Data":"c34ce192187aa883a23eb183f6b173e119ccb5b400b28fa72d605f12050de145"}
Jul 15 21:11:54.606322 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:11:54.606257    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t4kms" podStartSLOduration=1.9544237770000001 podStartE2EDuration="4.606241587s" totalImagesPullingTime="2.65181781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:54.604359578 +0000 UTC m=+335.297265621" watchObservedRunningTime="2026-07-15 21:11:54.606241587 +0000 UTC m=+335.299147629"
Jul 15 21:12:11.810614 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.810534    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"]
Jul 15 21:12:11.812606 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.812588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.814857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.814829    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-klg58\""
Jul 15 21:12:11.814857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.814851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:12:11.815012 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.814851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 21:12:11.822667 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.822642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"]
Jul 15 21:12:11.839654 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.839623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb6xd\" (UniqueName: \"kubernetes.io/projected/d0f272db-9323-4234-8151-730ebc03a8ec-kube-api-access-vb6xd\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.839789 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.839677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f272db-9323-4234-8151-730ebc03a8ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.940590 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.940551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f272db-9323-4234-8151-730ebc03a8ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.940780 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.940658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb6xd\" (UniqueName: \"kubernetes.io/projected/d0f272db-9323-4234-8151-730ebc03a8ec-kube-api-access-vb6xd\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.940958 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.940935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f272db-9323-4234-8151-730ebc03a8ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:11.950004 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:11.949980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb6xd\" (UniqueName: \"kubernetes.io/projected/d0f272db-9323-4234-8151-730ebc03a8ec-kube-api-access-vb6xd\") pod \"openshift-lws-operator-fd8ccff4c-8zjjj\" (UID: \"d0f272db-9323-4234-8151-730ebc03a8ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:12.121878 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:12.121795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"
Jul 15 21:12:12.251494 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:12.251463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj"]
Jul 15 21:12:12.254261 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:12:12.254233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f272db_9323_4234_8151_730ebc03a8ec.slice/crio-9b2d1db937ac2e07b1acb46d14cde739654a7cd27f1df368cf37bc77de5bd190 WatchSource:0}: Error finding container 9b2d1db937ac2e07b1acb46d14cde739654a7cd27f1df368cf37bc77de5bd190: Status 404 returned error can't find the container with id 9b2d1db937ac2e07b1acb46d14cde739654a7cd27f1df368cf37bc77de5bd190
Jul 15 21:12:12.662493 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:12.662460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj" event={"ID":"d0f272db-9323-4234-8151-730ebc03a8ec","Type":"ContainerStarted","Data":"9b2d1db937ac2e07b1acb46d14cde739654a7cd27f1df368cf37bc77de5bd190"}
Jul 15 21:12:15.680376 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:15.680335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj" event={"ID":"d0f272db-9323-4234-8151-730ebc03a8ec","Type":"ContainerStarted","Data":"e47b196d5e4d0088e4d568d9f7e8e04853a26081498a7bd4144fe00acdf5368f"}
Jul 15 21:12:15.698508 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:15.698448    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zjjj" podStartSLOduration=2.194180737 podStartE2EDuration="4.698420976s" totalImagesPullingTime="2.504240239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:15.695749999 +0000 UTC m=+356.388656068" watchObservedRunningTime="2026-07-15 21:12:15.698420976 +0000 UTC m=+356.391327019"
Jul 15 21:12:18.348712 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.348680    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"]
Jul 15 21:12:18.351374 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.351356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.353564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.353541    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 21:12:18.353674 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.353657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4zcp8\""
Jul 15 21:12:18.354218 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.354199    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 21:12:18.361108 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.361087    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"]
Jul 15 21:12:18.393995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.393969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.394152 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.394001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.394152 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.394028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whp7r\" (UniqueName: \"kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.494919 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.494890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.495035 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.494922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.495035 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.494953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whp7r\" (UniqueName: \"kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.495378 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.495357    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.495430 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.495364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.504656 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.504630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whp7r\" (UniqueName: \"kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.661351 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.661253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:18.797279 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:18.797241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"]
Jul 15 21:12:18.800456 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:12:18.800427    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090ef024_0ce1_4464_8b9c_b672fc38ce34.slice/crio-4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb WatchSource:0}: Error finding container 4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb: Status 404 returned error can't find the container with id 4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb
Jul 15 21:12:19.698443 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:19.698406    2581 generic.go:356] "Generic (PLEG): container finished" podID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerID="5c092cf979af83d64dbdbe28d8a892bb394d00961e4b8e3b974aba1775518392" exitCode=0
Jul 15 21:12:19.698858 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:19.698490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr" event={"ID":"090ef024-0ce1-4464-8b9c-b672fc38ce34","Type":"ContainerDied","Data":"5c092cf979af83d64dbdbe28d8a892bb394d00961e4b8e3b974aba1775518392"}
Jul 15 21:12:19.698858 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:19.698542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr" event={"ID":"090ef024-0ce1-4464-8b9c-b672fc38ce34","Type":"ContainerStarted","Data":"4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb"}
Jul 15 21:12:20.704423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:20.704389    2581 generic.go:356] "Generic (PLEG): container finished" podID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerID="cc35631dbc385ed48cdd2749cd48382442b8ce33c7e3faffbfb8bad77ddd25f0" exitCode=0
Jul 15 21:12:20.704885 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:20.704480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr" event={"ID":"090ef024-0ce1-4464-8b9c-b672fc38ce34","Type":"ContainerDied","Data":"cc35631dbc385ed48cdd2749cd48382442b8ce33c7e3faffbfb8bad77ddd25f0"}
Jul 15 21:12:21.711170 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:21.711135    2581 generic.go:356] "Generic (PLEG): container finished" podID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerID="606a465ec2d9d7b391aa7bfad6f61f68ed8885d4d0f8d2ba9c3d14b1a8d04ef1" exitCode=0
Jul 15 21:12:21.711570 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:21.711214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr" event={"ID":"090ef024-0ce1-4464-8b9c-b672fc38ce34","Type":"ContainerDied","Data":"606a465ec2d9d7b391aa7bfad6f61f68ed8885d4d0f8d2ba9c3d14b1a8d04ef1"}
Jul 15 21:12:22.848682 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.848658    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:22.930049 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.930023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whp7r\" (UniqueName: \"kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r\") pod \"090ef024-0ce1-4464-8b9c-b672fc38ce34\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") "
Jul 15 21:12:22.930224 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.930057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle\") pod \"090ef024-0ce1-4464-8b9c-b672fc38ce34\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") "
Jul 15 21:12:22.930224 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.930107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util\") pod \"090ef024-0ce1-4464-8b9c-b672fc38ce34\" (UID: \"090ef024-0ce1-4464-8b9c-b672fc38ce34\") "
Jul 15 21:12:22.930819 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.930794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle" (OuterVolumeSpecName: "bundle") pod "090ef024-0ce1-4464-8b9c-b672fc38ce34" (UID: "090ef024-0ce1-4464-8b9c-b672fc38ce34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:12:22.932334 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.932309    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r" (OuterVolumeSpecName: "kube-api-access-whp7r") pod "090ef024-0ce1-4464-8b9c-b672fc38ce34" (UID: "090ef024-0ce1-4464-8b9c-b672fc38ce34"). InnerVolumeSpecName "kube-api-access-whp7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:12:22.936101 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.936061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util" (OuterVolumeSpecName: "util") pod "090ef024-0ce1-4464-8b9c-b672fc38ce34" (UID: "090ef024-0ce1-4464-8b9c-b672fc38ce34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:12:22.938234 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938212    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"]
Jul 15 21:12:22.938553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938541    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="util"
Jul 15 21:12:22.938600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938555    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="util"
Jul 15 21:12:22.938600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938566    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="pull"
Jul 15 21:12:22.938600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938571    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="pull"
Jul 15 21:12:22.938600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938583    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="extract"
Jul 15 21:12:22.938600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938588    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="extract"
Jul 15 21:12:22.938747 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.938645    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="090ef024-0ce1-4464-8b9c-b672fc38ce34" containerName="extract"
Jul 15 21:12:22.940608 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.940592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:22.942776 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.942754    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 21:12:22.942898 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.942880    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 21:12:22.942943 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.942898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 21:12:22.943036 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.943017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4m5cr\""
Jul 15 21:12:22.951075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:22.951055    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"]
Jul 15 21:12:23.030963 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.030880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.030963 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.030923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9h2z\" (UniqueName: \"kubernetes.io/projected/68ceb8e5-c45b-47c4-91e6-64b1b3754996-kube-api-access-k9h2z\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.030963 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.030946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68ceb8e5-c45b-47c4-91e6-64b1b3754996-manager-config\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.031173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.031011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.031173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.031069    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whp7r\" (UniqueName: \"kubernetes.io/projected/090ef024-0ce1-4464-8b9c-b672fc38ce34-kube-api-access-whp7r\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:12:23.031173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.031082    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:12:23.031173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.031091    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/090ef024-0ce1-4464-8b9c-b672fc38ce34-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:12:23.132330 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.132274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68ceb8e5-c45b-47c4-91e6-64b1b3754996-manager-config\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.132551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.132344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.132551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.132408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.132551 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.132433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9h2z\" (UniqueName: \"kubernetes.io/projected/68ceb8e5-c45b-47c4-91e6-64b1b3754996-kube-api-access-k9h2z\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.133045 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.133022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68ceb8e5-c45b-47c4-91e6-64b1b3754996-manager-config\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.134881 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.134863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.134938 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.134893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68ceb8e5-c45b-47c4-91e6-64b1b3754996-cert\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.144298 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.144262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9h2z\" (UniqueName: \"kubernetes.io/projected/68ceb8e5-c45b-47c4-91e6-64b1b3754996-kube-api-access-k9h2z\") pod \"lws-controller-manager-6dd8d546cd-98pdm\" (UID: \"68ceb8e5-c45b-47c4-91e6-64b1b3754996\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.249965 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.249938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:23.391751 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.391729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"]
Jul 15 21:12:23.393758 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:12:23.393730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ceb8e5_c45b_47c4_91e6_64b1b3754996.slice/crio-ec59b2b5af802a42f3f332c2090b6d267a9574c226273e3b8d169a637ae33ed5 WatchSource:0}: Error finding container ec59b2b5af802a42f3f332c2090b6d267a9574c226273e3b8d169a637ae33ed5: Status 404 returned error can't find the container with id ec59b2b5af802a42f3f332c2090b6d267a9574c226273e3b8d169a637ae33ed5
Jul 15 21:12:23.720988 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.720952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm" event={"ID":"68ceb8e5-c45b-47c4-91e6-64b1b3754996","Type":"ContainerStarted","Data":"ec59b2b5af802a42f3f332c2090b6d267a9574c226273e3b8d169a637ae33ed5"}
Jul 15 21:12:23.722992 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.722967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr" event={"ID":"090ef024-0ce1-4464-8b9c-b672fc38ce34","Type":"ContainerDied","Data":"4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb"}
Jul 15 21:12:23.723122 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.723007    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d22ec3c4c274eaa05c07926dc9488dedc1bf8f474886a2536e9d8dca0e400eb"
Jul 15 21:12:23.723122 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:23.723022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwkxcr"
Jul 15 21:12:24.729455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:24.729415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm" event={"ID":"68ceb8e5-c45b-47c4-91e6-64b1b3754996","Type":"ContainerStarted","Data":"0c710c4f31875b09f49749ac694da46d10468186edd72984c69cdb933446dcd6"}
Jul 15 21:12:24.729812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:24.729475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:24.751322 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:24.748206    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm" podStartSLOduration=1.5411895850000001 podStartE2EDuration="2.748186458s" totalImagesPullingTime="1.206996873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:24.745445663 +0000 UTC m=+365.438351704" watchObservedRunningTime="2026-07-15 21:12:24.748186458 +0000 UTC m=+365.441092501"
Jul 15 21:12:35.454016 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.453979    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"]
Jul 15 21:12:35.457167 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.457133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.459155 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.459135    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 21:12:35.459593 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.459578    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zg2b8\""
Jul 15 21:12:35.459656 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.459606    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 21:12:35.459656 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.459611    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 21:12:35.459748 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.459659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 21:12:35.473894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.473867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"]
Jul 15 21:12:35.533824 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.533799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.533964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.533833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrn2p\" (UniqueName: \"kubernetes.io/projected/bd16b2cd-5a45-4f2c-8472-0745904e6575-kube-api-access-nrn2p\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.533964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.533853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.533964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.533869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.534067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.533999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635028 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrn2p\" (UniqueName: \"kubernetes.io/projected/bd16b2cd-5a45-4f2c-8472-0745904e6575-kube-api-access-nrn2p\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.635629 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.635601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.637362 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.637342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd16b2cd-5a45-4f2c-8472-0745904e6575-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.637586 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.637564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.637701 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.637686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd16b2cd-5a45-4f2c-8472-0745904e6575-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.647196 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.647169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrn2p\" (UniqueName: \"kubernetes.io/projected/bd16b2cd-5a45-4f2c-8472-0745904e6575-kube-api-access-nrn2p\") pod \"opendatahub-operator-controller-manager-858d4f578f-8kjnl\" (UID: \"bd16b2cd-5a45-4f2c-8472-0745904e6575\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.738185 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.738120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-98pdm"
Jul 15 21:12:35.768449 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.768418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:35.918231 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:35.918205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"]
Jul 15 21:12:35.920023 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:12:35.919998    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd16b2cd_5a45_4f2c_8472_0745904e6575.slice/crio-8cb46ad358fcccf442dd9dd6e2223cd812ce47921da7c650a6db7c3fe44ceeeb WatchSource:0}: Error finding container 8cb46ad358fcccf442dd9dd6e2223cd812ce47921da7c650a6db7c3fe44ceeeb: Status 404 returned error can't find the container with id 8cb46ad358fcccf442dd9dd6e2223cd812ce47921da7c650a6db7c3fe44ceeeb
Jul 15 21:12:36.787688 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:36.787648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl" event={"ID":"bd16b2cd-5a45-4f2c-8472-0745904e6575","Type":"ContainerStarted","Data":"8cb46ad358fcccf442dd9dd6e2223cd812ce47921da7c650a6db7c3fe44ceeeb"}
Jul 15 21:12:39.804799 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:39.804754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl" event={"ID":"bd16b2cd-5a45-4f2c-8472-0745904e6575","Type":"ContainerStarted","Data":"82fe908ed1e7da51d1d1a8a2883af003755e9da20a74a7bb248edf4ee051bdf8"}
Jul 15 21:12:40.810640 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:40.810605    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd16b2cd-5a45-4f2c-8472-0745904e6575" containerID="82fe908ed1e7da51d1d1a8a2883af003755e9da20a74a7bb248edf4ee051bdf8" exitCode=0
Jul 15 21:12:40.811024 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:40.810689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl" event={"ID":"bd16b2cd-5a45-4f2c-8472-0745904e6575","Type":"ContainerDied","Data":"82fe908ed1e7da51d1d1a8a2883af003755e9da20a74a7bb248edf4ee051bdf8"}
Jul 15 21:12:41.817641 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:41.817601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl" event={"ID":"bd16b2cd-5a45-4f2c-8472-0745904e6575","Type":"ContainerStarted","Data":"66fa12deaefdc7b85832a19bd66baadde4a893d57312600f0b3a4e4ef1fe9a27"}
Jul 15 21:12:41.818047 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:41.817674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:41.845270 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:41.844740    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl" podStartSLOduration=2.25705977 podStartE2EDuration="6.84472033s" totalImagesPullingTime="3.496562339s" totalInitContainerRuntime="1.091098221s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:41.84265403 +0000 UTC m=+382.535560075" watchObservedRunningTime="2026-07-15 21:12:41.84472033 +0000 UTC m=+382.537626374"
Jul 15 21:12:52.824886 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:52.824849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-8kjnl"
Jul 15 21:12:55.148011 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.147975    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"]
Jul 15 21:12:55.154857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.154833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.156629 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.156605    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:12:55.156760 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.156607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fj9vd\""
Jul 15 21:12:55.157198 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.157179    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 21:12:55.166174 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.166153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"]
Jul 15 21:12:55.312449 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.312420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tls-certs\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.312601 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.312454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tmp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.312601 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.312486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmbsp\" (UniqueName: \"kubernetes.io/projected/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-kube-api-access-jmbsp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.413177 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.413091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmbsp\" (UniqueName: \"kubernetes.io/projected/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-kube-api-access-jmbsp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.413177 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.413176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tls-certs\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.413409 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.413199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tmp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.416106 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.416078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tmp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.416238 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.416218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-tls-certs\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.435842 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.435813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmbsp\" (UniqueName: \"kubernetes.io/projected/945a6a4b-a3b7-4122-8c5a-4bc8531af02d-kube-api-access-jmbsp\") pod \"kube-auth-proxy-5bcb5978cd-gkqfv\" (UID: \"945a6a4b-a3b7-4122-8c5a-4bc8531af02d\") " pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.464510 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.464471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"
Jul 15 21:12:55.638515 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.638475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv"]
Jul 15 21:12:55.640485 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:12:55.640458    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945a6a4b_a3b7_4122_8c5a_4bc8531af02d.slice/crio-3a69dd8d30ca330ff821dc945486c12ca798106d2f9b57e26af29953941e7cae WatchSource:0}: Error finding container 3a69dd8d30ca330ff821dc945486c12ca798106d2f9b57e26af29953941e7cae: Status 404 returned error can't find the container with id 3a69dd8d30ca330ff821dc945486c12ca798106d2f9b57e26af29953941e7cae
Jul 15 21:12:55.881574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:55.881543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv" event={"ID":"945a6a4b-a3b7-4122-8c5a-4bc8531af02d","Type":"ContainerStarted","Data":"3a69dd8d30ca330ff821dc945486c12ca798106d2f9b57e26af29953941e7cae"}
Jul 15 21:12:58.897676 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:58.897583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv" event={"ID":"945a6a4b-a3b7-4122-8c5a-4bc8531af02d","Type":"ContainerStarted","Data":"fa4240d5b0361f81d81c168d9eb85d085d0f6a8fdd19b90d175223079a29f82c"}
Jul 15 21:12:58.915668 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:12:58.915619    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bcb5978cd-gkqfv" podStartSLOduration=1.124867551 podStartE2EDuration="3.915604003s" totalImagesPullingTime="2.790736452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:58.913859015 +0000 UTC m=+399.606765057" watchObservedRunningTime="2026-07-15 21:12:58.915604003 +0000 UTC m=+399.608510103"
Jul 15 21:14:11.511549 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.511513    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"]
Jul 15 21:14:11.514810 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.514793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.516790 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.516770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:14:11.516894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.516811    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:14:11.517250 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.517235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cc9h7\""
Jul 15 21:14:11.523491 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.523471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"]
Jul 15 21:14:11.632642 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.632601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.632845 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.632718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2xb\" (UniqueName: \"kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.632845 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.632778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.733500 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.733466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2xb\" (UniqueName: \"kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.733500 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.733505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.733737 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.733550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.733931 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.733912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.733975 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.733936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.742171 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.742148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2xb\" (UniqueName: \"kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.825213 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.825136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:11.958953 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:11.958931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"]
Jul 15 21:14:11.960664 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:14:11.960637    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990cd37d_23cf_4d6b_85d2_f2e3c756781e.slice/crio-65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a WatchSource:0}: Error finding container 65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a: Status 404 returned error can't find the container with id 65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a
Jul 15 21:14:12.225245 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.225214    2581 generic.go:356] "Generic (PLEG): container finished" podID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerID="0f00635a7a9485133efc17456734b9e4df9381af8fb8a89b9a0c2dd138691df7" exitCode=0
Jul 15 21:14:12.225427 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.225321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv" event={"ID":"990cd37d-23cf-4d6b-85d2-f2e3c756781e","Type":"ContainerDied","Data":"0f00635a7a9485133efc17456734b9e4df9381af8fb8a89b9a0c2dd138691df7"}
Jul 15 21:14:12.225427 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.225358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv" event={"ID":"990cd37d-23cf-4d6b-85d2-f2e3c756781e","Type":"ContainerStarted","Data":"65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a"}
Jul 15 21:14:12.315768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.315737    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"]
Jul 15 21:14:12.324675 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.324648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.328483 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.328458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"]
Jul 15 21:14:12.438978 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.438943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.439143 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.438990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.439143 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.439053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvsv\" (UniqueName: \"kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.539934 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.539847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvsv\" (UniqueName: \"kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.539934 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.539920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.540373 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.539951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.540434 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.540412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.540473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.540424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.549910 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.549889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvsv\" (UniqueName: \"kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.634922 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.634879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:12.769004 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.768979    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"]
Jul 15 21:14:12.770965 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:14:12.770933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826dd2d9_f312_49ff_8d98_05c768ebf23e.slice/crio-03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64 WatchSource:0}: Error finding container 03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64: Status 404 returned error can't find the container with id 03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64
Jul 15 21:14:12.916908 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.916882    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"]
Jul 15 21:14:12.921566 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.921550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:12.930219 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:12.930194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"]
Jul 15 21:14:13.044648 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.044623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.044758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.044657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.044758 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.044685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pw85\" (UniqueName: \"kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.146030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.145958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.146030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.145990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.146030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.146017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pw85\" (UniqueName: \"kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.146362 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.146344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.146362 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.146354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.154892 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.154867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pw85\" (UniqueName: \"kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.231669 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.231639    2581 generic.go:356] "Generic (PLEG): container finished" podID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerID="a082ef7418ecee199350871b349b75271fee4147f97e7609a606f0f8b0d6b69e" exitCode=0
Jul 15 21:14:13.231778 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.231713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl" event={"ID":"826dd2d9-f312-49ff-8d98-05c768ebf23e","Type":"ContainerDied","Data":"a082ef7418ecee199350871b349b75271fee4147f97e7609a606f0f8b0d6b69e"}
Jul 15 21:14:13.231778 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.231763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl" event={"ID":"826dd2d9-f312-49ff-8d98-05c768ebf23e","Type":"ContainerStarted","Data":"03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64"}
Jul 15 21:14:13.233534 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.233513    2581 generic.go:356] "Generic (PLEG): container finished" podID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerID="d858701775eba5eba77d28ee5961ca961069fb71bef44116fdb4aef50e8da342" exitCode=0
Jul 15 21:14:13.233618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.233563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv" event={"ID":"990cd37d-23cf-4d6b-85d2-f2e3c756781e","Type":"ContainerDied","Data":"d858701775eba5eba77d28ee5961ca961069fb71bef44116fdb4aef50e8da342"}
Jul 15 21:14:13.244465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.244431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:13.314258 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.314234    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"]
Jul 15 21:14:13.318416 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.318398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.331311 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.331264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"]
Jul 15 21:14:13.348079 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.347612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qwc\" (UniqueName: \"kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.348079 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.347686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.348079 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.347704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.390443 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.390419    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"]
Jul 15 21:14:13.392777 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:14:13.392750    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c400c3e_791a_4a29_a2ee_56ffb9d0aa23.slice/crio-800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894 WatchSource:0}: Error finding container 800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894: Status 404 returned error can't find the container with id 800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894
Jul 15 21:14:13.449319 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.449255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qwc\" (UniqueName: \"kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.449437 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.449377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.449437 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.449410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.449724 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.449707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.449763 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.449739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.458349 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.458331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qwc\" (UniqueName: \"kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.629151 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.629124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:13.758871 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:13.758850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"]
Jul 15 21:14:13.761203 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:14:13.761175    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63b2ade_109d_4833_ac75_b77b4e162781.slice/crio-0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade WatchSource:0}: Error finding container 0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade: Status 404 returned error can't find the container with id 0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade
Jul 15 21:14:14.243517 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.243487    2581 generic.go:356] "Generic (PLEG): container finished" podID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerID="06a403d74fbed2b2cdab726501c05796fed882bff0395eb0ed9bd60a6e58f17a" exitCode=0
Jul 15 21:14:14.243836 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.243575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl" event={"ID":"826dd2d9-f312-49ff-8d98-05c768ebf23e","Type":"ContainerDied","Data":"06a403d74fbed2b2cdab726501c05796fed882bff0395eb0ed9bd60a6e58f17a"}
Jul 15 21:14:14.245733 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.245714    2581 generic.go:356] "Generic (PLEG): container finished" podID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerID="65730e675d030f1575bff404f65cb7ebff0684cb172c4fb8387d44b8f47f7a11" exitCode=0
Jul 15 21:14:14.245853 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.245762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv" event={"ID":"990cd37d-23cf-4d6b-85d2-f2e3c756781e","Type":"ContainerDied","Data":"65730e675d030f1575bff404f65cb7ebff0684cb172c4fb8387d44b8f47f7a11"}
Jul 15 21:14:14.247129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.247094    2581 generic.go:356] "Generic (PLEG): container finished" podID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerID="46d975856bf806997571d10979e4fd9eb30e78f4c731c418891742378697ac96" exitCode=0
Jul 15 21:14:14.247229 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.247166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg" event={"ID":"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23","Type":"ContainerDied","Data":"46d975856bf806997571d10979e4fd9eb30e78f4c731c418891742378697ac96"}
Jul 15 21:14:14.247229 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.247207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg" event={"ID":"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23","Type":"ContainerStarted","Data":"800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894"}
Jul 15 21:14:14.248682 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.248592    2581 generic.go:356] "Generic (PLEG): container finished" podID="e63b2ade-109d-4833-ac75-b77b4e162781" containerID="437d9679b7c48bac41408808574d653309f7a914819c719ae7c96313608b116e" exitCode=0
Jul 15 21:14:14.248682 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.248667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerDied","Data":"437d9679b7c48bac41408808574d653309f7a914819c719ae7c96313608b116e"}
Jul 15 21:14:14.248786 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:14.248704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerStarted","Data":"0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade"}
Jul 15 21:14:15.256690 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.256659    2581 generic.go:356] "Generic (PLEG): container finished" podID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerID="99aefb58584c8908203ed7a0699077ba1e32af14e400bb21a936fd2441ca9eed" exitCode=0
Jul 15 21:14:15.257032 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.256723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl" event={"ID":"826dd2d9-f312-49ff-8d98-05c768ebf23e","Type":"ContainerDied","Data":"99aefb58584c8908203ed7a0699077ba1e32af14e400bb21a936fd2441ca9eed"}
Jul 15 21:14:15.258603 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.258582    2581 generic.go:356] "Generic (PLEG): container finished" podID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerID="32e688ee35631146970d4d3f24d2e783047ced50c07fec618638cd7c018f9bea" exitCode=0
Jul 15 21:14:15.258719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.258618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg" event={"ID":"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23","Type":"ContainerDied","Data":"32e688ee35631146970d4d3f24d2e783047ced50c07fec618638cd7c018f9bea"}
Jul 15 21:14:15.260824 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.260797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerStarted","Data":"83183894596be0c6ce891b419a72caf17a28892376b33eaba0522822b2b284cb"}
Jul 15 21:14:15.391174 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.391151    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:15.464906 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.464883    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b2xb\" (UniqueName: \"kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb\") pod \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") "
Jul 15 21:14:15.465030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.464974    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle\") pod \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") "
Jul 15 21:14:15.465030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.464992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util\") pod \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\" (UID: \"990cd37d-23cf-4d6b-85d2-f2e3c756781e\") "
Jul 15 21:14:15.465571 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.465546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle" (OuterVolumeSpecName: "bundle") pod "990cd37d-23cf-4d6b-85d2-f2e3c756781e" (UID: "990cd37d-23cf-4d6b-85d2-f2e3c756781e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:15.466889 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.466868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb" (OuterVolumeSpecName: "kube-api-access-6b2xb") pod "990cd37d-23cf-4d6b-85d2-f2e3c756781e" (UID: "990cd37d-23cf-4d6b-85d2-f2e3c756781e"). InnerVolumeSpecName "kube-api-access-6b2xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:14:15.470465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.470431    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util" (OuterVolumeSpecName: "util") pod "990cd37d-23cf-4d6b-85d2-f2e3c756781e" (UID: "990cd37d-23cf-4d6b-85d2-f2e3c756781e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:15.565977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.565949    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b2xb\" (UniqueName: \"kubernetes.io/projected/990cd37d-23cf-4d6b-85d2-f2e3c756781e-kube-api-access-6b2xb\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:15.565977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.565973    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:15.565977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:15.565981    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/990cd37d-23cf-4d6b-85d2-f2e3c756781e-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:16.266944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.266881    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv"
Jul 15 21:14:16.267331 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.266872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv" event={"ID":"990cd37d-23cf-4d6b-85d2-f2e3c756781e","Type":"ContainerDied","Data":"65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a"}
Jul 15 21:14:16.267331 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.266996    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65c05f1673e0aff7277da51aa5433c46a2a7f9e324074638214b96e2a2bce55a"
Jul 15 21:14:16.269108 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.269079    2581 generic.go:356] "Generic (PLEG): container finished" podID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerID="ab1bb33b3dbfb17c7c01bb99e96c466b1e01298ed6224b694d61cdbd3766669a" exitCode=0
Jul 15 21:14:16.269221 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.269171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg" event={"ID":"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23","Type":"ContainerDied","Data":"ab1bb33b3dbfb17c7c01bb99e96c466b1e01298ed6224b694d61cdbd3766669a"}
Jul 15 21:14:16.270820 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.270797    2581 generic.go:356] "Generic (PLEG): container finished" podID="e63b2ade-109d-4833-ac75-b77b4e162781" containerID="83183894596be0c6ce891b419a72caf17a28892376b33eaba0522822b2b284cb" exitCode=0
Jul 15 21:14:16.270939 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.270874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerDied","Data":"83183894596be0c6ce891b419a72caf17a28892376b33eaba0522822b2b284cb"}
Jul 15 21:14:16.414421 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.414393    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:16.472271 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.472247    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util\") pod \"826dd2d9-f312-49ff-8d98-05c768ebf23e\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") "
Jul 15 21:14:16.472407 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.472349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnvsv\" (UniqueName: \"kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv\") pod \"826dd2d9-f312-49ff-8d98-05c768ebf23e\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") "
Jul 15 21:14:16.472407 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.472374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle\") pod \"826dd2d9-f312-49ff-8d98-05c768ebf23e\" (UID: \"826dd2d9-f312-49ff-8d98-05c768ebf23e\") "
Jul 15 21:14:16.472863 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.472831    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle" (OuterVolumeSpecName: "bundle") pod "826dd2d9-f312-49ff-8d98-05c768ebf23e" (UID: "826dd2d9-f312-49ff-8d98-05c768ebf23e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:16.474372 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.474347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv" (OuterVolumeSpecName: "kube-api-access-wnvsv") pod "826dd2d9-f312-49ff-8d98-05c768ebf23e" (UID: "826dd2d9-f312-49ff-8d98-05c768ebf23e"). InnerVolumeSpecName "kube-api-access-wnvsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:14:16.477535 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.477496    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util" (OuterVolumeSpecName: "util") pod "826dd2d9-f312-49ff-8d98-05c768ebf23e" (UID: "826dd2d9-f312-49ff-8d98-05c768ebf23e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:16.573525 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.573469    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:16.573525 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.573491    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnvsv\" (UniqueName: \"kubernetes.io/projected/826dd2d9-f312-49ff-8d98-05c768ebf23e-kube-api-access-wnvsv\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:16.573525 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:16.573502    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826dd2d9-f312-49ff-8d98-05c768ebf23e-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:17.277630 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.277596    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl"
Jul 15 21:14:17.278030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.277600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl" event={"ID":"826dd2d9-f312-49ff-8d98-05c768ebf23e","Type":"ContainerDied","Data":"03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64"}
Jul 15 21:14:17.278030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.277726    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03895529bfcf6de5c6ad3d70ee2eb6fdc186afe8ded7c8ac784a4494f4ce4b64"
Jul 15 21:14:17.279681 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.279655    2581 generic.go:356] "Generic (PLEG): container finished" podID="e63b2ade-109d-4833-ac75-b77b4e162781" containerID="16ae7a5713ff244d4c9ba53b60554c07c107c2832a1eda1cf77745c80aea604a" exitCode=0
Jul 15 21:14:17.279805 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.279682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerDied","Data":"16ae7a5713ff244d4c9ba53b60554c07c107c2832a1eda1cf77745c80aea604a"}
Jul 15 21:14:17.409123 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.409100    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:17.479144 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.479116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util\") pod \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") "
Jul 15 21:14:17.479280 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.479175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle\") pod \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") "
Jul 15 21:14:17.479280 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.479262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pw85\" (UniqueName: \"kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85\") pod \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\" (UID: \"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23\") "
Jul 15 21:14:17.479641 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.479613    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle" (OuterVolumeSpecName: "bundle") pod "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" (UID: "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:17.481318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.481267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85" (OuterVolumeSpecName: "kube-api-access-2pw85") pod "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" (UID: "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23"). InnerVolumeSpecName "kube-api-access-2pw85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:14:17.487275 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.487251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util" (OuterVolumeSpecName: "util") pod "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" (UID: "0c400c3e-791a-4a29-a2ee-56ffb9d0aa23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:17.580598 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.580538    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:17.580598 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.580560    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:17.580598 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:17.580569    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pw85\" (UniqueName: \"kubernetes.io/projected/0c400c3e-791a-4a29-a2ee-56ffb9d0aa23-kube-api-access-2pw85\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:18.288209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.288121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg" event={"ID":"0c400c3e-791a-4a29-a2ee-56ffb9d0aa23","Type":"ContainerDied","Data":"800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894"}
Jul 15 21:14:18.288209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.288182    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="800082b6368b7ff9a24a3dee7f4d09464ee3a287fb0d557039395761be1db894"
Jul 15 21:14:18.288209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.288138    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg"
Jul 15 21:14:18.418027 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.418005    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:18.487401 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.487373    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util\") pod \"e63b2ade-109d-4833-ac75-b77b4e162781\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") "
Jul 15 21:14:18.487535 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.487426    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7qwc\" (UniqueName: \"kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc\") pod \"e63b2ade-109d-4833-ac75-b77b4e162781\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") "
Jul 15 21:14:18.487535 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.487457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle\") pod \"e63b2ade-109d-4833-ac75-b77b4e162781\" (UID: \"e63b2ade-109d-4833-ac75-b77b4e162781\") "
Jul 15 21:14:18.487991 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.487965    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle" (OuterVolumeSpecName: "bundle") pod "e63b2ade-109d-4833-ac75-b77b4e162781" (UID: "e63b2ade-109d-4833-ac75-b77b4e162781"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:18.489465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.489446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc" (OuterVolumeSpecName: "kube-api-access-n7qwc") pod "e63b2ade-109d-4833-ac75-b77b4e162781" (UID: "e63b2ade-109d-4833-ac75-b77b4e162781"). InnerVolumeSpecName "kube-api-access-n7qwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:14:18.492105 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.492069    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util" (OuterVolumeSpecName: "util") pod "e63b2ade-109d-4833-ac75-b77b4e162781" (UID: "e63b2ade-109d-4833-ac75-b77b4e162781"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:14:18.588564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.588505    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-util\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:18.588564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.588527    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7qwc\" (UniqueName: \"kubernetes.io/projected/e63b2ade-109d-4833-ac75-b77b4e162781-kube-api-access-n7qwc\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:18.588564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:18.588537    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63b2ade-109d-4833-ac75-b77b4e162781-bundle\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:14:19.294084 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:19.294054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl"
Jul 15 21:14:19.294084 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:19.294065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl" event={"ID":"e63b2ade-109d-4833-ac75-b77b4e162781","Type":"ContainerDied","Data":"0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade"}
Jul 15 21:14:19.294489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:19.294106    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d775e116b6122a332718ad4ddf150335b6fb1174f0fca0fa53b7c317aa5aade"
Jul 15 21:14:25.207967 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.207933    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7947cfc8f4-bc6hr"]
Jul 15 21:14:25.208481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208425    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="util"
Jul 15 21:14:25.208481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208445    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="util"
Jul 15 21:14:25.208481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208459    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="util"
Jul 15 21:14:25.208481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208466    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="util"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208497    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208506    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208515    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208525    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208533    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208573    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208588    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="util"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208596    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="util"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208618    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="util"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208627    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="util"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208635    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208645    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208650    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="pull"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208655    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="extract"
Jul 15 21:14:25.208655 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208662    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="extract"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208670    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="pull"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208676    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="pull"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208730    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c400c3e-791a-4a29-a2ee-56ffb9d0aa23" containerName="extract"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208737    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="990cd37d-23cf-4d6b-85d2-f2e3c756781e" containerName="extract"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208746    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63b2ade-109d-4833-ac75-b77b4e162781" containerName="extract"
Jul 15 21:14:25.209161 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.208753    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="826dd2d9-f312-49ff-8d98-05c768ebf23e" containerName="extract"
Jul 15 21:14:25.212001 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.211976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.217146 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217121    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 21:14:25.217377 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 21:14:25.217496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 21:14:25.217496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 21:14:25.217612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lbxz\""
Jul 15 21:14:25.217612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.217603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 21:14:25.220445 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.220424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 21:14:25.224446 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.224424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7947cfc8f4-bc6hr"]
Jul 15 21:14:25.336379 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-oauth-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-service-ca\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-console-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-trusted-ca-bundle\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-oauth-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336653 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.336653 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.336593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjwf\" (UniqueName: \"kubernetes.io/projected/819a891d-d8c4-4244-835d-b2365604f4dd-kube-api-access-mtjwf\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437598 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-oauth-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-service-ca\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-console-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-trusted-ca-bundle\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-oauth-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.437784 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.437774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjwf\" (UniqueName: \"kubernetes.io/projected/819a891d-d8c4-4244-835d-b2365604f4dd-kube-api-access-mtjwf\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.438448 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.438424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-console-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.438553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.438424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-oauth-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.438553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.438511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-service-ca\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.438675 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.438658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819a891d-d8c4-4244-835d-b2365604f4dd-trusted-ca-bundle\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.440150 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.440123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-oauth-config\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.440243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.440224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819a891d-d8c4-4244-835d-b2365604f4dd-console-serving-cert\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.447204 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.447185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjwf\" (UniqueName: \"kubernetes.io/projected/819a891d-d8c4-4244-835d-b2365604f4dd-kube-api-access-mtjwf\") pod \"console-7947cfc8f4-bc6hr\" (UID: \"819a891d-d8c4-4244-835d-b2365604f4dd\") " pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.524375 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.524314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:25.660218 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:25.660195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7947cfc8f4-bc6hr"]
Jul 15 21:14:25.662177 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:14:25.662149    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819a891d_d8c4_4244_835d_b2365604f4dd.slice/crio-165899aff54d9f36959430bb6ac222608e0f276c7ba84812764e46238e683306 WatchSource:0}: Error finding container 165899aff54d9f36959430bb6ac222608e0f276c7ba84812764e46238e683306: Status 404 returned error can't find the container with id 165899aff54d9f36959430bb6ac222608e0f276c7ba84812764e46238e683306
Jul 15 21:14:26.330022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:26.329992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cfc8f4-bc6hr" event={"ID":"819a891d-d8c4-4244-835d-b2365604f4dd","Type":"ContainerStarted","Data":"55e1151168df2928085f12c39771930718b5ed405bbdd49f8d3b92660b05b1de"}
Jul 15 21:14:26.330390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:26.330036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cfc8f4-bc6hr" event={"ID":"819a891d-d8c4-4244-835d-b2365604f4dd","Type":"ContainerStarted","Data":"165899aff54d9f36959430bb6ac222608e0f276c7ba84812764e46238e683306"}
Jul 15 21:14:26.351710 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:26.351659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7947cfc8f4-bc6hr" podStartSLOduration=1.351646777 podStartE2EDuration="1.351646777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:26.349841657 +0000 UTC m=+487.042747697" watchObservedRunningTime="2026-07-15 21:14:26.351646777 +0000 UTC m=+487.044552818"
Jul 15 21:14:35.524651 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:35.524615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:35.525113 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:35.524678    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:35.529200 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:35.529177    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:14:36.382100 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:14:36.382067    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7947cfc8f4-bc6hr"
Jul 15 21:15:45.960508 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.960431    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:15:45.963589 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.963570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:45.965447 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.965427    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:15:45.965569 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.965427    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 21:15:45.965569 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.965474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cc9h7\""
Jul 15 21:15:45.965818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.965800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:15:45.972444 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:45.972422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:15:46.005133 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.005111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:15:46.110635 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.110603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl6ln\" (UniqueName: \"kubernetes.io/projected/004ebb16-85b8-41ed-b3d4-88ca99e440ee-kube-api-access-rl6ln\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.110770 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.110660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/004ebb16-85b8-41ed-b3d4-88ca99e440ee-config-file\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.211323 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.211227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl6ln\" (UniqueName: \"kubernetes.io/projected/004ebb16-85b8-41ed-b3d4-88ca99e440ee-kube-api-access-rl6ln\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.211323 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.211307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/004ebb16-85b8-41ed-b3d4-88ca99e440ee-config-file\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.211853 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.211836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/004ebb16-85b8-41ed-b3d4-88ca99e440ee-config-file\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.220148 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.220118    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl6ln\" (UniqueName: \"kubernetes.io/projected/004ebb16-85b8-41ed-b3d4-88ca99e440ee-kube-api-access-rl6ln\") pod \"limitador-limitador-54d6d988d5-pwsjw\" (UID: \"004ebb16-85b8-41ed-b3d4-88ca99e440ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.275253 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.275226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:46.408714 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.408681    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:46.413062 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.413041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:15:46.413156 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.413135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:46.414443 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:15:46.414418    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004ebb16_85b8_41ed_b3d4_88ca99e440ee.slice/crio-088965cdeb76f447c54d38e5ff6447223d87bc4ec64c3ddfb5f031e32e66c64f WatchSource:0}: Error finding container 088965cdeb76f447c54d38e5ff6447223d87bc4ec64c3ddfb5f031e32e66c64f: Status 404 returned error can't find the container with id 088965cdeb76f447c54d38e5ff6447223d87bc4ec64c3ddfb5f031e32e66c64f
Jul 15 21:15:46.415003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.414980    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7sq2m\""
Jul 15 21:15:46.420212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.420194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:46.512907 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.512841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrmbr\" (UniqueName: \"kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr\") pod \"authorino-58cd955675-kbthn\" (UID: \"3866fd65-5cc0-4a88-a888-dd3cdadd594e\") " pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:46.613735 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.613706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrmbr\" (UniqueName: \"kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr\") pod \"authorino-58cd955675-kbthn\" (UID: \"3866fd65-5cc0-4a88-a888-dd3cdadd594e\") " pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:46.622511 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.622487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrmbr\" (UniqueName: \"kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr\") pod \"authorino-58cd955675-kbthn\" (UID: \"3866fd65-5cc0-4a88-a888-dd3cdadd594e\") " pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:46.693707 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.693680    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:15:46.696977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.696961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:15:46.706272 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.706250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:15:46.725187 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.725165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw" event={"ID":"004ebb16-85b8-41ed-b3d4-88ca99e440ee","Type":"ContainerStarted","Data":"088965cdeb76f447c54d38e5ff6447223d87bc4ec64c3ddfb5f031e32e66c64f"}
Jul 15 21:15:46.730399 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.730386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:46.814919 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.814876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vct49\" (UniqueName: \"kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49\") pod \"authorino-75d556bd77-nqqsx\" (UID: \"27331ab9-db21-49d7-ae8e-0aafd8c0b206\") " pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:15:46.857739 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.857716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:46.859764 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:15:46.859737    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3866fd65_5cc0_4a88_a888_dd3cdadd594e.slice/crio-c2f552fa2895ef43a38350898e0e2489a7df813356b0fdc5498163f9fe3a559a WatchSource:0}: Error finding container c2f552fa2895ef43a38350898e0e2489a7df813356b0fdc5498163f9fe3a559a: Status 404 returned error can't find the container with id c2f552fa2895ef43a38350898e0e2489a7df813356b0fdc5498163f9fe3a559a
Jul 15 21:15:46.915425 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.915392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vct49\" (UniqueName: \"kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49\") pod \"authorino-75d556bd77-nqqsx\" (UID: \"27331ab9-db21-49d7-ae8e-0aafd8c0b206\") " pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:15:46.924641 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:46.924616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vct49\" (UniqueName: \"kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49\") pod \"authorino-75d556bd77-nqqsx\" (UID: \"27331ab9-db21-49d7-ae8e-0aafd8c0b206\") " pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:15:47.006354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:47.006327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:15:47.171219 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:47.170863    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:15:47.175387 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:15:47.175354    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27331ab9_db21_49d7_ae8e_0aafd8c0b206.slice/crio-cb517349216a96afbe5ff366202a67c46f5cfbfa113dd584ca7c0e5b13c543c5 WatchSource:0}: Error finding container cb517349216a96afbe5ff366202a67c46f5cfbfa113dd584ca7c0e5b13c543c5: Status 404 returned error can't find the container with id cb517349216a96afbe5ff366202a67c46f5cfbfa113dd584ca7c0e5b13c543c5
Jul 15 21:15:47.735232 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:47.735190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kbthn" event={"ID":"3866fd65-5cc0-4a88-a888-dd3cdadd594e","Type":"ContainerStarted","Data":"c2f552fa2895ef43a38350898e0e2489a7df813356b0fdc5498163f9fe3a559a"}
Jul 15 21:15:47.736665 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:47.736634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nqqsx" event={"ID":"27331ab9-db21-49d7-ae8e-0aafd8c0b206","Type":"ContainerStarted","Data":"cb517349216a96afbe5ff366202a67c46f5cfbfa113dd584ca7c0e5b13c543c5"}
Jul 15 21:15:51.773135 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.773090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kbthn" event={"ID":"3866fd65-5cc0-4a88-a888-dd3cdadd594e","Type":"ContainerStarted","Data":"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"}
Jul 15 21:15:51.775487 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.775420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw" event={"ID":"004ebb16-85b8-41ed-b3d4-88ca99e440ee","Type":"ContainerStarted","Data":"43d429322c2d64d90a606dee217c0e6fb6d0c6dcdb4a24a6a4d52d01cd4da599"}
Jul 15 21:15:51.775608 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.775583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:15:51.779164 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.778624    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nqqsx" event={"ID":"27331ab9-db21-49d7-ae8e-0aafd8c0b206","Type":"ContainerStarted","Data":"f6352c6e68633d5f2d692832f46bfe6064dba38973fa4a1d4cfa5adfb1b2a591"}
Jul 15 21:15:51.791828 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.791772    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kbthn" podStartSLOduration=1.024247759 podStartE2EDuration="5.791754047s" totalImagesPullingTime="4.767506288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:51.790908723 +0000 UTC m=+572.483814765" watchObservedRunningTime="2026-07-15 21:15:51.791754047 +0000 UTC m=+572.484660089"
Jul 15 21:15:51.810198 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.809706    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw" podStartSLOduration=1.610314703 podStartE2EDuration="6.809687263s" totalImagesPullingTime="5.19937256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:51.808314622 +0000 UTC m=+572.501220659" watchObservedRunningTime="2026-07-15 21:15:51.809687263 +0000 UTC m=+572.502593306"
Jul 15 21:15:51.823248 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.823199    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nqqsx" podStartSLOduration=1.384417292 podStartE2EDuration="5.823182693s" totalImagesPullingTime="4.438765401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:51.821861646 +0000 UTC m=+572.514767732" watchObservedRunningTime="2026-07-15 21:15:51.823182693 +0000 UTC m=+572.516088735"
Jul 15 21:15:51.854122 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:51.854082    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:53.789050 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:53.789014    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kbthn" podUID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" containerName="authorino" containerID="cri-o://f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db" gracePeriod=30
Jul 15 21:15:54.035509 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.035483    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:54.082506 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.082423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrmbr\" (UniqueName: \"kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr\") pod \"3866fd65-5cc0-4a88-a888-dd3cdadd594e\" (UID: \"3866fd65-5cc0-4a88-a888-dd3cdadd594e\") "
Jul 15 21:15:54.084430 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.084407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr" (OuterVolumeSpecName: "kube-api-access-qrmbr") pod "3866fd65-5cc0-4a88-a888-dd3cdadd594e" (UID: "3866fd65-5cc0-4a88-a888-dd3cdadd594e"). InnerVolumeSpecName "kube-api-access-qrmbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:15:54.183058 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.183027    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrmbr\" (UniqueName: \"kubernetes.io/projected/3866fd65-5cc0-4a88-a888-dd3cdadd594e-kube-api-access-qrmbr\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:15:54.795020 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.794991    2581 generic.go:356] "Generic (PLEG): container finished" podID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" containerID="f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db" exitCode=0
Jul 15 21:15:54.795469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.795028    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kbthn"
Jul 15 21:15:54.795469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.795081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kbthn" event={"ID":"3866fd65-5cc0-4a88-a888-dd3cdadd594e","Type":"ContainerDied","Data":"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"}
Jul 15 21:15:54.795469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.795119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kbthn" event={"ID":"3866fd65-5cc0-4a88-a888-dd3cdadd594e","Type":"ContainerDied","Data":"c2f552fa2895ef43a38350898e0e2489a7df813356b0fdc5498163f9fe3a559a"}
Jul 15 21:15:54.795469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.795136    2581 scope.go:117] "RemoveContainer" containerID="f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"
Jul 15 21:15:54.804406 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.804380    2581 scope.go:117] "RemoveContainer" containerID="f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"
Jul 15 21:15:54.804655 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:15:54.804637    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db\": container with ID starting with f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db not found: ID does not exist" containerID="f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"
Jul 15 21:15:54.804719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.804664    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db"} err="failed to get container status \"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db\": rpc error: code = NotFound desc = could not find container \"f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db\": container with ID starting with f5bd36fe004185755753587267f4e4a8219f9929285bc915e097fdcb1814a9db not found: ID does not exist"
Jul 15 21:15:54.825579 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.825557    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:54.830045 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:54.830024    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kbthn"]
Jul 15 21:15:56.001902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:15:56.001856    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" path="/var/lib/kubelet/pods/3866fd65-5cc0-4a88-a888-dd3cdadd594e/volumes"
Jul 15 21:16:02.784751 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:02.784719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"
Jul 15 21:16:19.818443 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:19.818415    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:16:19.818952 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:19.818416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:16:19.821832 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:19.821810    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:16:19.821832 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:19.821824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:16:20.249924 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.249891    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:20.250252 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.250237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" containerName="authorino"
Jul 15 21:16:20.250318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.250254    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" containerName="authorino"
Jul 15 21:16:20.250359 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.250350    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3866fd65-5cc0-4a88-a888-dd3cdadd594e" containerName="authorino"
Jul 15 21:16:20.256031 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.256010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:20.260925 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.260895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:20.309880 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.309850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k949f\" (UniqueName: \"kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f\") pod \"authorino-5d4b67c446-lltvj\" (UID: \"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe\") " pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:20.410274 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.410242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k949f\" (UniqueName: \"kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f\") pod \"authorino-5d4b67c446-lltvj\" (UID: \"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe\") " pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:20.420035 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.420002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k949f\" (UniqueName: \"kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f\") pod \"authorino-5d4b67c446-lltvj\" (UID: \"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe\") " pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:20.490506 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.490468    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:20.490759 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.490746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:20.627884 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.627849    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:20.631258 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:16:20.631228    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcd4ce05_eaad_4310_9f33_dc1381f3a9fe.slice/crio-48f11e53959ff9de8667000eb332d5daec818e945e17f78b282b438e13c1db57 WatchSource:0}: Error finding container 48f11e53959ff9de8667000eb332d5daec818e945e17f78b282b438e13c1db57: Status 404 returned error can't find the container with id 48f11e53959ff9de8667000eb332d5daec818e945e17f78b282b438e13c1db57
Jul 15 21:16:20.925761 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:20.925671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lltvj" event={"ID":"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe","Type":"ContainerStarted","Data":"48f11e53959ff9de8667000eb332d5daec818e945e17f78b282b438e13c1db57"}
Jul 15 21:16:21.932596 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:21.932565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lltvj" event={"ID":"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe","Type":"ContainerStarted","Data":"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"}
Jul 15 21:16:21.933039 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:21.932641    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-lltvj" podUID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" containerName="authorino" containerID="cri-o://6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8" gracePeriod=30
Jul 15 21:16:21.949916 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:21.949872    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-lltvj" podStartSLOduration=1.614643942 podStartE2EDuration="1.949856404s" totalImagesPullingTime="335.212462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:21.948528128 +0000 UTC m=+602.641434171" watchObservedRunningTime="2026-07-15 21:16:21.949856404 +0000 UTC m=+602.642762469"
Jul 15 21:16:22.183195 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.183141    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:22.227258 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.227218    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k949f\" (UniqueName: \"kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f\") pod \"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe\" (UID: \"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe\") "
Jul 15 21:16:22.229333 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.229310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f" (OuterVolumeSpecName: "kube-api-access-k949f") pod "fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" (UID: "fcd4ce05-eaad-4310-9f33-dc1381f3a9fe"). InnerVolumeSpecName "kube-api-access-k949f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:16:22.328011 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.327959    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k949f\" (UniqueName: \"kubernetes.io/projected/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe-kube-api-access-k949f\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:16:22.939116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.939079    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" containerID="6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8" exitCode=0
Jul 15 21:16:22.939116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.939119    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lltvj"
Jul 15 21:16:22.939572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.939125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lltvj" event={"ID":"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe","Type":"ContainerDied","Data":"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"}
Jul 15 21:16:22.939572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.939176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lltvj" event={"ID":"fcd4ce05-eaad-4310-9f33-dc1381f3a9fe","Type":"ContainerDied","Data":"48f11e53959ff9de8667000eb332d5daec818e945e17f78b282b438e13c1db57"}
Jul 15 21:16:22.939572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.939199    2581 scope.go:117] "RemoveContainer" containerID="6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"
Jul 15 21:16:22.949130 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.949112    2581 scope.go:117] "RemoveContainer" containerID="6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"
Jul 15 21:16:22.949398 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:16:22.949376    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8\": container with ID starting with 6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8 not found: ID does not exist" containerID="6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"
Jul 15 21:16:22.949473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.949410    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8"} err="failed to get container status \"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8\": rpc error: code = NotFound desc = could not find container \"6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8\": container with ID starting with 6add93654bb0da460605375de1ba82e16558d44654eddaf5d84e58bb29dc48a8 not found: ID does not exist"
Jul 15 21:16:22.963067 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.963043    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:22.965453 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:22.965434    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lltvj"]
Jul 15 21:16:24.002167 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:24.002119    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" path="/var/lib/kubelet/pods/fcd4ce05-eaad-4310-9f33-dc1381f3a9fe/volumes"
Jul 15 21:16:25.765605 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:25.765571    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:16:25.765995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:25.765750    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nqqsx" podUID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" containerName="authorino" containerID="cri-o://f6352c6e68633d5f2d692832f46bfe6064dba38973fa4a1d4cfa5adfb1b2a591" gracePeriod=30
Jul 15 21:16:25.965017 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:25.964981    2581 generic.go:356] "Generic (PLEG): container finished" podID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" containerID="f6352c6e68633d5f2d692832f46bfe6064dba38973fa4a1d4cfa5adfb1b2a591" exitCode=0
Jul 15 21:16:25.965199 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:25.965060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nqqsx" event={"ID":"27331ab9-db21-49d7-ae8e-0aafd8c0b206","Type":"ContainerDied","Data":"f6352c6e68633d5f2d692832f46bfe6064dba38973fa4a1d4cfa5adfb1b2a591"}
Jul 15 21:16:26.010203 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.010170    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:16:26.065455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.065366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vct49\" (UniqueName: \"kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49\") pod \"27331ab9-db21-49d7-ae8e-0aafd8c0b206\" (UID: \"27331ab9-db21-49d7-ae8e-0aafd8c0b206\") "
Jul 15 21:16:26.067614 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.067586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49" (OuterVolumeSpecName: "kube-api-access-vct49") pod "27331ab9-db21-49d7-ae8e-0aafd8c0b206" (UID: "27331ab9-db21-49d7-ae8e-0aafd8c0b206"). InnerVolumeSpecName "kube-api-access-vct49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:16:26.166568 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.166524    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vct49\" (UniqueName: \"kubernetes.io/projected/27331ab9-db21-49d7-ae8e-0aafd8c0b206-kube-api-access-vct49\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:16:26.971627 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.971588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nqqsx"
Jul 15 21:16:26.971627 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.971603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nqqsx" event={"ID":"27331ab9-db21-49d7-ae8e-0aafd8c0b206","Type":"ContainerDied","Data":"cb517349216a96afbe5ff366202a67c46f5cfbfa113dd584ca7c0e5b13c543c5"}
Jul 15 21:16:26.972134 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.971655    2581 scope.go:117] "RemoveContainer" containerID="f6352c6e68633d5f2d692832f46bfe6064dba38973fa4a1d4cfa5adfb1b2a591"
Jul 15 21:16:26.995701 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:26.995677    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:16:27.001625 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:27.001599    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nqqsx"]
Jul 15 21:16:28.001651 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:16:28.001620    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" path="/var/lib/kubelet/pods/27331ab9-db21-49d7-ae8e-0aafd8c0b206/volumes"
Jul 15 21:17:05.184030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:05.183994    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:17:34.998358 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:34.998324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:17:44.626975 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.626944    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"]
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627318    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" containerName="authorino"
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627331    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" containerName="authorino"
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627341    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" containerName="authorino"
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627348    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" containerName="authorino"
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627415    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27331ab9-db21-49d7-ae8e-0aafd8c0b206" containerName="authorino"
Jul 15 21:17:44.627435 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.627428    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd4ce05-eaad-4310-9f33-dc1381f3a9fe" containerName="authorino"
Jul 15 21:17:44.630057 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.630040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.632529 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.632510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 21:17:44.633075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.633057    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 21:17:44.633159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.633140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ms4wp\""
Jul 15 21:17:44.633226 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.633186    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 21:17:44.647354 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.647328    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"]
Jul 15 21:17:44.719216 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.719423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.719423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.719423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6xc\" (UniqueName: \"kubernetes.io/projected/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-kube-api-access-vf6xc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.719423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.719423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.719413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820077 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820077 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6xc\" (UniqueName: \"kubernetes.io/projected/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-kube-api-access-vf6xc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820622 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820683 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.820720 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.820694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.822456 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.822432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.822628 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.822610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.828774 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.828749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6xc\" (UniqueName: \"kubernetes.io/projected/06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc-kube-api-access-vf6xc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lx4xh\" (UID: \"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:44.940230 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:44.940193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:45.079934 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:45.079856    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"]
Jul 15 21:17:45.082638 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:17:45.082611    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ba5b44_d343_4e2c_a283_7e1bc4a2e1bc.slice/crio-13c87735a4a698d57814553cd84fa80ebdc521ffa4a9b575e244f8e07f3c140e WatchSource:0}: Error finding container 13c87735a4a698d57814553cd84fa80ebdc521ffa4a9b575e244f8e07f3c140e: Status 404 returned error can't find the container with id 13c87735a4a698d57814553cd84fa80ebdc521ffa4a9b575e244f8e07f3c140e
Jul 15 21:17:45.083888 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:45.083868    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:17:45.301046 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:45.300962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:17:45.385679 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:45.385604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh" event={"ID":"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc","Type":"ContainerStarted","Data":"13c87735a4a698d57814553cd84fa80ebdc521ffa4a9b575e244f8e07f3c140e"}
Jul 15 21:17:46.392243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:46.392141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh" event={"ID":"06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc","Type":"ContainerStarted","Data":"a368081f85e9476f42ac37f1fb32fee869eeceb5c11784edea1026d9efd64060"}
Jul 15 21:17:46.412102 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:46.412039    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh" podStartSLOduration=1.3866240300000001 podStartE2EDuration="2.412024056s" totalImagesPullingTime="1.025400026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:46.41090562 +0000 UTC m=+687.103811662" watchObservedRunningTime="2026-07-15 21:17:46.412024056 +0000 UTC m=+687.104930097"
Jul 15 21:17:51.188886 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:51.188838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:17:54.940790 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:54.940745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:54.941278 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:54.940818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:54.953759 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:54.953727    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:55.450645 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:55.450611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lx4xh"
Jul 15 21:17:57.690599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:17:57.690562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:18:05.203917 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:05.203881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:18:09.876794 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.876760    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"]
Jul 15 21:18:09.880519 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.880496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.882890 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.882867    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 21:18:09.890902 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.890879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"]
Jul 15 21:18:09.945111 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.945111 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.945348 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.945348 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.945348 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzczw\" (UniqueName: \"kubernetes.io/projected/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-kube-api-access-wzczw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:09.945348 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:09.945345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046659 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.046872 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.046829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzczw\" (UniqueName: \"kubernetes.io/projected/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-kube-api-access-wzczw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.047238 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.047199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.047409 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.047236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.047409 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.047260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.049040 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.049015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.049340 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.049321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.059535 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.059513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzczw\" (UniqueName: \"kubernetes.io/projected/99f2e12d-07fd-4e7b-a53d-1031a1f188c7-kube-api-access-wzczw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr\" (UID: \"99f2e12d-07fd-4e7b-a53d-1031a1f188c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.190005 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.189973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:10.330362 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.330333    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"]
Jul 15 21:18:10.332405 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:18:10.332380    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99f2e12d_07fd_4e7b_a53d_1031a1f188c7.slice/crio-59f2488c8b16a657bc6924ba0104b61706a63d0b6cb126b41bada93e0f6aa5d7 WatchSource:0}: Error finding container 59f2488c8b16a657bc6924ba0104b61706a63d0b6cb126b41bada93e0f6aa5d7: Status 404 returned error can't find the container with id 59f2488c8b16a657bc6924ba0104b61706a63d0b6cb126b41bada93e0f6aa5d7
Jul 15 21:18:10.520665 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:10.520628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr" event={"ID":"99f2e12d-07fd-4e7b-a53d-1031a1f188c7","Type":"ContainerStarted","Data":"59f2488c8b16a657bc6924ba0104b61706a63d0b6cb126b41bada93e0f6aa5d7"}
Jul 15 21:18:11.527414 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:11.527330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr" event={"ID":"99f2e12d-07fd-4e7b-a53d-1031a1f188c7","Type":"ContainerStarted","Data":"e45f607572de39232f3197046240d9e1d00b783a2af8ebfab085e85abf49303b"}
Jul 15 21:18:11.548569 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:11.548513    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr" podStartSLOduration=2.384103513 podStartE2EDuration="2.548496362s" totalImagesPullingTime="164.392849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:11.546029515 +0000 UTC m=+712.238935586" watchObservedRunningTime="2026-07-15 21:18:11.548496362 +0000 UTC m=+712.241402403"
Jul 15 21:18:18.291616 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:18.291578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:18:20.190353 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:20.190318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:20.190353 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:20.190359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:20.202982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:20.202955    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:18:20.585656 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:18:20.585577    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr"
Jul 15 21:19:15.594677 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.594636    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b564d89b5-hc9sr"]
Jul 15 21:19:15.598344 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.598317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.601129 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.601102    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7sq2m\""
Jul 15 21:19:15.601259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.601135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 21:19:15.606363 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.606341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b564d89b5-hc9sr"]
Jul 15 21:19:15.646455 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.646415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2j6\" (UniqueName: \"kubernetes.io/projected/b11d3359-11ca-4172-98c3-528dc2ab6b9e-kube-api-access-7d2j6\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.646638 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.646511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b11d3359-11ca-4172-98c3-528dc2ab6b9e-tls-cert\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.747181 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.747144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2j6\" (UniqueName: \"kubernetes.io/projected/b11d3359-11ca-4172-98c3-528dc2ab6b9e-kube-api-access-7d2j6\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.747373 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.747203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b11d3359-11ca-4172-98c3-528dc2ab6b9e-tls-cert\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.749709 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.749685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b11d3359-11ca-4172-98c3-528dc2ab6b9e-tls-cert\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.765749 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.765718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2j6\" (UniqueName: \"kubernetes.io/projected/b11d3359-11ca-4172-98c3-528dc2ab6b9e-kube-api-access-7d2j6\") pod \"authorino-6b564d89b5-hc9sr\" (UID: \"b11d3359-11ca-4172-98c3-528dc2ab6b9e\") " pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:15.908543 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:15.908443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b564d89b5-hc9sr"
Jul 15 21:19:16.070672 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:16.070641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b564d89b5-hc9sr"]
Jul 15 21:19:16.072835 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:19:16.072792    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb11d3359_11ca_4172_98c3_528dc2ab6b9e.slice/crio-da06e9036c1a22ce0e33a059a611394f2dfb6f3c0fa84ccd5713fcb725ab1ea9 WatchSource:0}: Error finding container da06e9036c1a22ce0e33a059a611394f2dfb6f3c0fa84ccd5713fcb725ab1ea9: Status 404 returned error can't find the container with id da06e9036c1a22ce0e33a059a611394f2dfb6f3c0fa84ccd5713fcb725ab1ea9
Jul 15 21:19:16.858015 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:16.857980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b564d89b5-hc9sr" event={"ID":"b11d3359-11ca-4172-98c3-528dc2ab6b9e","Type":"ContainerStarted","Data":"c041ab18f23f317db1a61cbc2377c1bb34f3ce902be8886e549ca7414348fd57"}
Jul 15 21:19:16.858489 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:16.858024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b564d89b5-hc9sr" event={"ID":"b11d3359-11ca-4172-98c3-528dc2ab6b9e","Type":"ContainerStarted","Data":"da06e9036c1a22ce0e33a059a611394f2dfb6f3c0fa84ccd5713fcb725ab1ea9"}
Jul 15 21:19:45.000672 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:45.000558    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b564d89b5-hc9sr" podStartSLOduration=29.680321349 podStartE2EDuration="30.000542117s" totalImagesPullingTime="320.220768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:16.886873399 +0000 UTC m=+777.579779455" watchObservedRunningTime="2026-07-15 21:19:45.000542117 +0000 UTC m=+805.693448209"
Jul 15 21:19:45.001181 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:45.000757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:19:55.490309 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:19:55.490256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:20:06.396459 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:20:06.396422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:20:27.706746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:20:27.706712    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:20:55.181544 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:20:55.181505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:21:06.990368 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:06.990336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:21:19.852394 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:19.852367    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:21:19.855116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:19.855090    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:21:19.855592 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:19.855573    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:21:19.858192 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:19.858175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:21:40.884898 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:40.884854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:21:50.386280 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:21:50.386242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:00.001662 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:00.001629    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:11.105277 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:11.105235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:20.863862 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:20.863823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:30.522254 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:30.522209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:41.913823 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:41.913736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:22:51.689539 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:22:51.689501    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:23:14.396167 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:23:14.396123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:23:25.898216 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:23:25.898180    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:23:49.602501 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:23:49.602470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:24:06.205786 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:24:06.205747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:24:18.316490 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:24:18.316405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:24:27.512323 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:24:27.512277    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:24:39.600162 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:24:39.600128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:25:43.784954 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:25:43.784858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:26:19.885137 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:26:19.885108    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:26:19.888280 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:26:19.888257    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:26:19.890436 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:26:19.890419    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:26:19.893526 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:26:19.893509    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:27:26.219114 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:27:26.219080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:27:37.097090 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:27:37.097055    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:27:48.124102 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:27:48.124059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:27:59.692391 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:27:59.692354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:28:09.083246 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:28:09.083214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:28:20.290849 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:28:20.290817    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:28:29.493829 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:28:29.493794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:28:39.716517 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:28:39.716483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:28:50.601065 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:28:50.600979    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:29:00.789606 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:29:00.789575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:29:11.293718 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:29:11.293680    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:29:32.501915 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:29:32.501885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:29:41.802586 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:29:41.802550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:29:53.603053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:29:53.603017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:30:06.093864 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:30:06.093830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:30:22.593704 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:30:22.593671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:30:33.889652 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:30:33.889615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:30:43.686553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:30:43.686516    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:30:51.313529 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:30:51.313490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:03.294439 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:03.294399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:13.091815 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:13.091776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:19.919168 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:19.919140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:31:19.922422 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:19.922399    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:31:19.925091 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:19.925070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:31:19.928192 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:19.928172    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:31:27.005701 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:27.005667    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:36.046589 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:36.046551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:45.514217 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:45.514132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:31:57.931601 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:31:57.931563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:32:10.205350 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:32:10.205319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:32:19.697525 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:32:19.697488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:32:31.309907 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:32:31.309871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:32:43.593991 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:32:43.593955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:32:55.855924 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:32:55.855883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:33:08.896588 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:33:08.896548    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:33:22.400635 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:33:22.400550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:33:32.584894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:33:32.584858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:33:43.082318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:33:43.082270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:33:53.482231 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:33:53.482195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:34:03.584193 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:34:03.584156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:34:12.482355 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:34:12.482318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:34:24.087818 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:34:24.087780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:35:53.685214 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:35:53.685173    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:36:01.691173 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:01.691131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:36:11.084027 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:11.083985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:36:19.953187 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:19.953155    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:36:19.956146 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:19.956122    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:36:19.960630 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:19.960605    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:36:19.963505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:19.963485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:36:23.292576 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:23.292530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:36:34.992700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:36:34.992661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:37:05.787465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:37:05.787425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:37:13.984914 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:37:13.984872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:38:06.804072 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:06.804031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:38:14.385880 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.385849    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:38:14.389270 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.389253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.391412 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.391392    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-99ed79\"/\"kube-root-ca.crt\""
Jul 15 21:38:14.391548 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.391491    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-99ed79\"/\"openshift-service-ca.crt\""
Jul 15 21:38:14.391949 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.391932    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-99ed79\"/\"test-model-99ed79-kserve-self-signed-certs\""
Jul 15 21:38:14.392026 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.391975    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-99ed79\"/\"default-dockercfg-84fmq\""
Jul 15 21:38:14.400322 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.400302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:38:14.471392 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.471532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.471532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.471621 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwc5\" (UniqueName: \"kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.471621 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.471689 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.471624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572529 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572529 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwc5\" (UniqueName: \"kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572904 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.572990 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.573025 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.572993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.573071 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.573042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.574735 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.574717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.575165 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.575148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.581911 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.581885    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwc5\" (UniqueName: \"kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5\") pod \"test-model-99ed79-kserve-554c9997d7-8vvdd\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") " pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.698694 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.698667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:14.835413 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:14.835388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:38:14.837701 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:38:14.837659    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2af82942_4412_4fd5_a0a7_8bacd9545e32.slice/crio-217a4670dce4d0878442bfb320029163cb569928b3a6fe92ff18440a8b7256bf WatchSource:0}: Error finding container 217a4670dce4d0878442bfb320029163cb569928b3a6fe92ff18440a8b7256bf: Status 404 returned error can't find the container with id 217a4670dce4d0878442bfb320029163cb569928b3a6fe92ff18440a8b7256bf
Jul 15 21:38:15.700851 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:15.700812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" event={"ID":"2af82942-4412-4fd5-a0a7-8bacd9545e32","Type":"ContainerStarted","Data":"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"}
Jul 15 21:38:15.700851 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:15.700857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" event={"ID":"2af82942-4412-4fd5-a0a7-8bacd9545e32","Type":"ContainerStarted","Data":"217a4670dce4d0878442bfb320029163cb569928b3a6fe92ff18440a8b7256bf"}
Jul 15 21:38:15.719549 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:15.719483    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" podStartSLOduration=1.719467541 podStartE2EDuration="1.719467541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:15.719096607 +0000 UTC m=+1916.412002678" watchObservedRunningTime="2026-07-15 21:38:15.719467541 +0000 UTC m=+1916.412373583"
Jul 15 21:38:22.091023 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:22.090982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:38:24.698952 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:24.698906    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:24.699471 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:24.698991    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:24.711719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:24.711694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:24.762481 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:24.762451    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:38:48.608044 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.608010    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:38:48.611685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.611667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.614607 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.614571    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-518fcf\"/\"test-model-518fcf-kserve-self-signed-certs\""
Jul 15 21:38:48.614607 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.614575    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-518fcf\"/\"default-dockercfg-9vv5p\""
Jul 15 21:38:48.614805 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.614614    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-518fcf\"/\"openshift-service-ca.crt\""
Jul 15 21:38:48.614805 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.614675    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-518fcf\"/\"kube-root-ca.crt\""
Jul 15 21:38:48.623969 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.623946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:38:48.667497 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.667657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlr7m\" (UniqueName: \"kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.667657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.667657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.667657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.667816 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.667685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769107 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlr7m\" (UniqueName: \"kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769809 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769809 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769809 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.769809 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.769717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.771499 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.771469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.771770 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.771754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.779023 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.778993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlr7m\" (UniqueName: \"kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m\") pod \"test-model-518fcf-kserve-54f4b98df9-69zdm\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") " pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:48.920601 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:48.920512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:49.056341 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:49.056315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:38:49.058175 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:38:49.058136    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2f5110_8bc9_44de_9303_cddcd3afd196.slice/crio-83bbd94b33654df8d78ff79a10c812e97307eabea98b719d20579785100a5a4f WatchSource:0}: Error finding container 83bbd94b33654df8d78ff79a10c812e97307eabea98b719d20579785100a5a4f: Status 404 returned error can't find the container with id 83bbd94b33654df8d78ff79a10c812e97307eabea98b719d20579785100a5a4f
Jul 15 21:38:49.878049 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:49.878011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" event={"ID":"ac2f5110-8bc9-44de-9303-cddcd3afd196","Type":"ContainerStarted","Data":"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"}
Jul 15 21:38:49.878479 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:49.878060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" event={"ID":"ac2f5110-8bc9-44de-9303-cddcd3afd196","Type":"ContainerStarted","Data":"83bbd94b33654df8d78ff79a10c812e97307eabea98b719d20579785100a5a4f"}
Jul 15 21:38:49.897539 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:49.897490    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" podStartSLOduration=1.897472976 podStartE2EDuration="1.897472976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:49.895669534 +0000 UTC m=+1950.588575615" watchObservedRunningTime="2026-07-15 21:38:49.897472976 +0000 UTC m=+1950.590379049"
Jul 15 21:38:52.686423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:52.686385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:38:58.920856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:58.920819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:58.920856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:58.920864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:58.933856 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:58.933830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:38:58.945209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:38:58.945182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:39:06.881159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:06.881120    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:39:25.358961 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:25.358925    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:39:26.315451 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:26.315412    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:39:30.798443 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:30.798406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:39:40.379014 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.378969    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" podUID="2af82942-4412-4fd5-a0a7-8bacd9545e32" containerName="main" containerID="cri-o://326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9" gracePeriod=45
Jul 15 21:39:40.626772 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.626746    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:39:40.730075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730046    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730150    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730214    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxwc5\" (UniqueName: \"kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5\") pod \"2af82942-4412-4fd5-a0a7-8bacd9545e32\" (UID: \"2af82942-4412-4fd5-a0a7-8bacd9545e32\") "
Jul 15 21:39:40.730541 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730458    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home" (OuterVolumeSpecName: "home") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:40.730541 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730468    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache" (OuterVolumeSpecName: "model-cache") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:40.730541 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730488    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:40.730685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730553    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:40.730685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730568    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:40.730685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.730578    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:40.732480 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.732451    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5" (OuterVolumeSpecName: "kube-api-access-zxwc5") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "kube-api-access-zxwc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:39:40.732480 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.732466    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm" (OuterVolumeSpecName: "dshm") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:40.732624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.732485    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2af82942-4412-4fd5-a0a7-8bacd9545e32" (UID: "2af82942-4412-4fd5-a0a7-8bacd9545e32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:39:40.831263 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.831232    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2af82942-4412-4fd5-a0a7-8bacd9545e32-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:40.831263 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.831259    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2af82942-4412-4fd5-a0a7-8bacd9545e32-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:40.831449 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:40.831270    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxwc5\" (UniqueName: \"kubernetes.io/projected/2af82942-4412-4fd5-a0a7-8bacd9545e32-kube-api-access-zxwc5\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.147612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.147518    2581 generic.go:356] "Generic (PLEG): container finished" podID="2af82942-4412-4fd5-a0a7-8bacd9545e32" containerID="326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9" exitCode=0
Jul 15 21:39:41.147612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.147565    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"
Jul 15 21:39:41.147612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.147574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" event={"ID":"2af82942-4412-4fd5-a0a7-8bacd9545e32","Type":"ContainerDied","Data":"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"}
Jul 15 21:39:41.147612 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.147606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd" event={"ID":"2af82942-4412-4fd5-a0a7-8bacd9545e32","Type":"ContainerDied","Data":"217a4670dce4d0878442bfb320029163cb569928b3a6fe92ff18440a8b7256bf"}
Jul 15 21:39:41.147912 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.147623    2581 scope.go:117] "RemoveContainer" containerID="326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"
Jul 15 21:39:41.159558 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.159539    2581 scope.go:117] "RemoveContainer" containerID="326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"
Jul 15 21:39:41.159856 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:39:41.159835    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9\": container with ID starting with 326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9 not found: ID does not exist" containerID="326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"
Jul 15 21:39:41.160001 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.159871    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9"} err="failed to get container status \"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9\": rpc error: code = NotFound desc = could not find container \"326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9\": container with ID starting with 326a747370b04df075128e1ace9f5def3a8555096efaba4b5b4cd77e6defe2a9 not found: ID does not exist"
Jul 15 21:39:41.173258 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.173235    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:39:41.180720 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.180699    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-99ed79/test-model-99ed79-kserve-554c9997d7-8vvdd"]
Jul 15 21:39:41.335423 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.335364    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" podUID="ac2f5110-8bc9-44de-9303-cddcd3afd196" containerName="main" containerID="cri-o://56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344" gracePeriod=45
Jul 15 21:39:41.588075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.588049    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:39:41.739736 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739652    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.739736 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.739935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlr7m\" (UniqueName: \"kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.739935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.739935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.739935 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.739824    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs\") pod \"ac2f5110-8bc9-44de-9303-cddcd3afd196\" (UID: \"ac2f5110-8bc9-44de-9303-cddcd3afd196\") "
Jul 15 21:39:41.740158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.740006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:41.740158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.740026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home" (OuterVolumeSpecName: "home") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:41.740158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.740118    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.740158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.740133    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.740158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.740141    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:41.742116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.742087    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m" (OuterVolumeSpecName: "kube-api-access-vlr7m") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "kube-api-access-vlr7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:39:41.742116 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.742103    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm" (OuterVolumeSpecName: "dshm") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:41.742267 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.742124    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac2f5110-8bc9-44de-9303-cddcd3afd196" (UID: "ac2f5110-8bc9-44de-9303-cddcd3afd196"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:39:41.840950 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.840920    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlr7m\" (UniqueName: \"kubernetes.io/projected/ac2f5110-8bc9-44de-9303-cddcd3afd196-kube-api-access-vlr7m\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.840950 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.840946    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.841130 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.840957    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f5110-8bc9-44de-9303-cddcd3afd196-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:41.841130 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:41.840966    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f5110-8bc9-44de-9303-cddcd3afd196-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:39:42.002521 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.002429    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af82942-4412-4fd5-a0a7-8bacd9545e32" path="/var/lib/kubelet/pods/2af82942-4412-4fd5-a0a7-8bacd9545e32/volumes"
Jul 15 21:39:42.153913 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.153876    2581 generic.go:356] "Generic (PLEG): container finished" podID="ac2f5110-8bc9-44de-9303-cddcd3afd196" containerID="56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344" exitCode=0
Jul 15 21:39:42.154076 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.153926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"
Jul 15 21:39:42.154076 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.153969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" event={"ID":"ac2f5110-8bc9-44de-9303-cddcd3afd196","Type":"ContainerDied","Data":"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"}
Jul 15 21:39:42.154076 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.154011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm" event={"ID":"ac2f5110-8bc9-44de-9303-cddcd3afd196","Type":"ContainerDied","Data":"83bbd94b33654df8d78ff79a10c812e97307eabea98b719d20579785100a5a4f"}
Jul 15 21:39:42.154076 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.154030    2581 scope.go:117] "RemoveContainer" containerID="56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"
Jul 15 21:39:42.163088 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.163071    2581 scope.go:117] "RemoveContainer" containerID="56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"
Jul 15 21:39:42.163361 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:39:42.163334    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344\": container with ID starting with 56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344 not found: ID does not exist" containerID="56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"
Jul 15 21:39:42.163424 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.163372    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344"} err="failed to get container status \"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344\": rpc error: code = NotFound desc = could not find container \"56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344\": container with ID starting with 56b91fbae136d79df4f96b66e75ad63137f690d66527abfd9c21588dd2177344 not found: ID does not exist"
Jul 15 21:39:42.174978 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.174955    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:39:42.177240 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:42.177218    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-518fcf/test-model-518fcf-kserve-54f4b98df9-69zdm"]
Jul 15 21:39:44.002058 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:39:44.002010    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2f5110-8bc9-44de-9303-cddcd3afd196" path="/var/lib/kubelet/pods/ac2f5110-8bc9-44de-9303-cddcd3afd196/volumes"
Jul 15 21:40:12.685539 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:40:12.685501    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:40:27.428613 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:40:27.428577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:40:37.204626 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:40:37.204592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:40:57.112554 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:40:57.112474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:41:13.000187 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:13.000151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:41:19.985972 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:19.985944    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:41:19.992247 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:19.992223    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:41:19.999325 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:19.999278    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:41:20.002803 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:20.002784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:41:23.287668 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:23.287634    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:41:38.084073 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:38.084038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:41:53.090053 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090018    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:41:53.090624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090589    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2f5110-8bc9-44de-9303-cddcd3afd196" containerName="main"
Jul 15 21:41:53.090624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090610    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2f5110-8bc9-44de-9303-cddcd3afd196" containerName="main"
Jul 15 21:41:53.090743 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090632    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af82942-4412-4fd5-a0a7-8bacd9545e32" containerName="main"
Jul 15 21:41:53.090743 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af82942-4412-4fd5-a0a7-8bacd9545e32" containerName="main"
Jul 15 21:41:53.090849 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090761    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af82942-4412-4fd5-a0a7-8bacd9545e32" containerName="main"
Jul 15 21:41:53.090849 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.090777    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2f5110-8bc9-44de-9303-cddcd3afd196" containerName="main"
Jul 15 21:41:53.093919 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.093897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.097505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.097482    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"kube-root-ca.crt\""
Jul 15 21:41:53.097600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.097514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"default-dockercfg-dqt7s\""
Jul 15 21:41:53.097600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.097514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"auth-test-model-fa020c-kserve-self-signed-certs\""
Jul 15 21:41:53.097600 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.097482    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"openshift-service-ca.crt\""
Jul 15 21:41:53.104137 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.104114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:41:53.260071 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.260238 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7kl\" (UniqueName: \"kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.260238 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.260238 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.260395 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.260395 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.260316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361029 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.360939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361029 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.360983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7kl\" (UniqueName: \"kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361212 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361311 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361356 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361410 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361543 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.361628 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.361609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.363239 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.363211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.363556 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.363540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.370982 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.370960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7kl\" (UniqueName: \"kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl\") pod \"auth-test-model-fa020c-kserve-86dc698555-jt9fr\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") " pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.403850 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.403819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:41:53.543366 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.543339    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:41:53.544832 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:41:53.544795    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda34e70df_2bdd_455b_b4dd_0d2897aa8c45.slice/crio-281dcf784f6eb959a39e47a736827a5cb77f24c4833f9c862af3c69090b0def8 WatchSource:0}: Error finding container 281dcf784f6eb959a39e47a736827a5cb77f24c4833f9c862af3c69090b0def8: Status 404 returned error can't find the container with id 281dcf784f6eb959a39e47a736827a5cb77f24c4833f9c862af3c69090b0def8
Jul 15 21:41:53.835599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.835557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" event={"ID":"a34e70df-2bdd-455b-b4dd-0d2897aa8c45","Type":"ContainerStarted","Data":"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"}
Jul 15 21:41:53.835793 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:53.835639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" event={"ID":"a34e70df-2bdd-455b-b4dd-0d2897aa8c45","Type":"ContainerStarted","Data":"281dcf784f6eb959a39e47a736827a5cb77f24c4833f9c862af3c69090b0def8"}
Jul 15 21:41:56.491445 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:56.491385    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" podStartSLOduration=3.491366916 podStartE2EDuration="3.491366916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:53.869809612 +0000 UTC m=+2134.562715690" watchObservedRunningTime="2026-07-15 21:41:56.491366916 +0000 UTC m=+2137.184272955"
Jul 15 21:41:56.492387 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:41:56.492362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:42:03.404130 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:03.404088    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:42:03.404599 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:03.404149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:42:03.416709 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:03.416687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:42:03.899162 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:03.899121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:42:57.988022 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.987987    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:42:57.991164 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.991146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:57.993661 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.993631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"auth-test-model-7ef33e-kserve-self-signed-certs\""
Jul 15 21:42:57.993799 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.993648    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"kube-root-ca.crt\""
Jul 15 21:42:57.993799 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.993700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"default-dockercfg-p57q5\""
Jul 15 21:42:57.993799 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:57.993648    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"openshift-service-ca.crt\""
Jul 15 21:42:58.006098 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.006075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:42:58.012513 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.012624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.012624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.012624 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.012791 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84pm\" (UniqueName: \"kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.012859 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.012794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113202 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84pm\" (UniqueName: \"kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113388 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113388 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113388 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113388 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113388 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113774 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113774 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.113889 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.113800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.115424 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.115409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.115766 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.115750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.125911 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.125891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84pm\" (UniqueName: \"kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm\") pod \"auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") " pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.301827 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.301749    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:42:58.441964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:58.441939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:42:58.443862 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:42:58.443833    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc4a9b9_25a8_4f9e_8658_ea299bc73713.slice/crio-d38f2a238f9b7c72ef9163404706952144fb0373af35b9783e4d859d53a42eee WatchSource:0}: Error finding container d38f2a238f9b7c72ef9163404706952144fb0373af35b9783e4d859d53a42eee: Status 404 returned error can't find the container with id d38f2a238f9b7c72ef9163404706952144fb0373af35b9783e4d859d53a42eee
Jul 15 21:42:59.170332 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:59.170277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" event={"ID":"6bc4a9b9-25a8-4f9e-8658-ea299bc73713","Type":"ContainerStarted","Data":"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"}
Jul 15 21:42:59.170726 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:59.170346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" event={"ID":"6bc4a9b9-25a8-4f9e-8658-ea299bc73713","Type":"ContainerStarted","Data":"d38f2a238f9b7c72ef9163404706952144fb0373af35b9783e4d859d53a42eee"}
Jul 15 21:42:59.190748 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:42:59.190699    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" podStartSLOduration=2.190685724 podStartE2EDuration="2.190685724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:59.189831765 +0000 UTC m=+2199.882737808" watchObservedRunningTime="2026-07-15 21:42:59.190685724 +0000 UTC m=+2199.883591766"
Jul 15 21:43:01.684450 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:01.684417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:43:08.302495 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:08.302450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:43:08.302495 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:08.302505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:43:08.315228 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:08.315209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:43:09.233367 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:09.233341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:43:17.509046 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:17.509005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:43:35.892719 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:35.892678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:43:50.783246 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:43:50.783169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:44:07.390878 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:44:07.390842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:44:25.384708 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:44:25.384674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:44:44.584718 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:44:44.584683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:45:02.384547 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:02.384513    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:45:05.501626 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:05.501589    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:45:06.462209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:06.462169    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:45:16.892437 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:16.892358    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:45:16.896110 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:16.896093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:16.898445 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:16.898421    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"sub-test-model-fa020c-kserve-self-signed-certs\""
Jul 15 21:45:16.907014 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:16.906984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:45:17.006182 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.006382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.006382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.006382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd67g\" (UniqueName: \"kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.006382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.006382 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.006313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107188 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107345 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd67g\" (UniqueName: \"kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107345 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107437 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107475 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107521 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107601 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.107806 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.107782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.109460 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.109438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.109782 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.109765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.116901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.116877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd67g\" (UniqueName: \"kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g\") pod \"sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") " pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.205963 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.205937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:17.341480 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.341457    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:45:17.343648 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:45:17.343620    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a8555ae_f0fa_4b40_875a_bb6ced68ccfb.slice/crio-382536e8e7efb42b408a5dbb1a67d8f3e4dacf3dd29cc3858d2d6c7cc4cf0146 WatchSource:0}: Error finding container 382536e8e7efb42b408a5dbb1a67d8f3e4dacf3dd29cc3858d2d6c7cc4cf0146: Status 404 returned error can't find the container with id 382536e8e7efb42b408a5dbb1a67d8f3e4dacf3dd29cc3858d2d6c7cc4cf0146
Jul 15 21:45:17.882019 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.881981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" event={"ID":"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb","Type":"ContainerStarted","Data":"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"}
Jul 15 21:45:17.882202 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.882031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" event={"ID":"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb","Type":"ContainerStarted","Data":"382536e8e7efb42b408a5dbb1a67d8f3e4dacf3dd29cc3858d2d6c7cc4cf0146"}
Jul 15 21:45:17.900920 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:17.900865    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" podStartSLOduration=1.900846657 podStartE2EDuration="1.900846657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:17.90017493 +0000 UTC m=+2338.593080969" watchObservedRunningTime="2026-07-15 21:45:17.900846657 +0000 UTC m=+2338.593752699"
Jul 15 21:45:20.522473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.522432    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" podUID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" containerName="main" containerID="cri-o://7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a" gracePeriod=45
Jul 15 21:45:20.776999 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.776945    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:45:20.898754 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.898720    2581 generic.go:356] "Generic (PLEG): container finished" podID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" containerID="7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a" exitCode=0
Jul 15 21:45:20.898894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.898760    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"
Jul 15 21:45:20.898894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.898805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" event={"ID":"a34e70df-2bdd-455b-b4dd-0d2897aa8c45","Type":"ContainerDied","Data":"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"}
Jul 15 21:45:20.898894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.898849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr" event={"ID":"a34e70df-2bdd-455b-b4dd-0d2897aa8c45","Type":"ContainerDied","Data":"281dcf784f6eb959a39e47a736827a5cb77f24c4833f9c862af3c69090b0def8"}
Jul 15 21:45:20.898894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.898866    2581 scope.go:117] "RemoveContainer" containerID="7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"
Jul 15 21:45:20.907654 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.907637    2581 scope.go:117] "RemoveContainer" containerID="7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"
Jul 15 21:45:20.907902 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:45:20.907876    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a\": container with ID starting with 7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a not found: ID does not exist" containerID="7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"
Jul 15 21:45:20.907946 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.907908    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a"} err="failed to get container status \"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a\": rpc error: code = NotFound desc = could not find container \"7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a\": container with ID starting with 7f0ad58977e91cb1b0bdcc910f612b0fd6dacb19d33daae1a606d8df9bc43c3a not found: ID does not exist"
Jul 15 21:45:20.938265 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938379 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938310    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938379 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv7kl\" (UniqueName: \"kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir\") pod \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\" (UID: \"a34e70df-2bdd-455b-b4dd-0d2897aa8c45\") "
Jul 15 21:45:20.938629 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache" (OuterVolumeSpecName: "model-cache") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.938629 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home" (OuterVolumeSpecName: "home") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.938765 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938742    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.938895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938776    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:20.938895 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.938743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.940664 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.940626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm" (OuterVolumeSpecName: "dshm") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:20.940751 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.940701    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:45:20.940751 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:20.940717    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl" (OuterVolumeSpecName: "kube-api-access-vv7kl") pod "a34e70df-2bdd-455b-b4dd-0d2897aa8c45" (UID: "a34e70df-2bdd-455b-b4dd-0d2897aa8c45"). InnerVolumeSpecName "kube-api-access-vv7kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:21.039894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.039829    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv7kl\" (UniqueName: \"kubernetes.io/projected/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-kube-api-access-vv7kl\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.039894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.039854    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.039894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.039868    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.039894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.039878    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34e70df-2bdd-455b-b4dd-0d2897aa8c45-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.228619 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.228590    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:45:21.234095 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.234076    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/auth-test-model-fa020c-kserve-86dc698555-jt9fr"]
Jul 15 21:45:21.380323 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.380250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:45:21.482722 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.482673    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" podUID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" containerName="main" containerID="cri-o://aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444" gracePeriod=45
Jul 15 21:45:21.736635 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.736606    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:45:21.848094 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848094 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848372 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848138    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848372 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848166    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m84pm\" (UniqueName: \"kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848372 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848235    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848372 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848278    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache\") pod \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\" (UID: \"6bc4a9b9-25a8-4f9e-8658-ea299bc73713\") "
Jul 15 21:45:21.848602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home" (OuterVolumeSpecName: "home") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:21.848602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:21.848602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848570    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache" (OuterVolumeSpecName: "model-cache") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:21.848837 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848815    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.848913 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848842    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.848913 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.848858    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.850509 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.850479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:45:21.850635 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.850614    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm" (OuterVolumeSpecName: "kube-api-access-m84pm") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "kube-api-access-m84pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:45:21.852121 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.852100    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm" (OuterVolumeSpecName: "dshm") pod "6bc4a9b9-25a8-4f9e-8658-ea299bc73713" (UID: "6bc4a9b9-25a8-4f9e-8658-ea299bc73713"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:45:21.906746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.906669    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" containerID="aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444" exitCode=0
Jul 15 21:45:21.906746 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.906747    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"
Jul 15 21:45:21.906936 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.906754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" event={"ID":"6bc4a9b9-25a8-4f9e-8658-ea299bc73713","Type":"ContainerDied","Data":"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"}
Jul 15 21:45:21.906936 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.906799    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp" event={"ID":"6bc4a9b9-25a8-4f9e-8658-ea299bc73713","Type":"ContainerDied","Data":"d38f2a238f9b7c72ef9163404706952144fb0373af35b9783e4d859d53a42eee"}
Jul 15 21:45:21.906936 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.906816    2581 scope.go:117] "RemoveContainer" containerID="aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"
Jul 15 21:45:21.915553 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.915536    2581 scope.go:117] "RemoveContainer" containerID="aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"
Jul 15 21:45:21.915783 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:45:21.915766    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444\": container with ID starting with aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444 not found: ID does not exist" containerID="aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"
Jul 15 21:45:21.915835 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.915790    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444"} err="failed to get container status \"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444\": rpc error: code = NotFound desc = could not find container \"aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444\": container with ID starting with aa7f7ebd86eedc3a565966c0231e829dae1f4121d7c68a26b7a3b2af3e97e444 not found: ID does not exist"
Jul 15 21:45:21.940191 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.940167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:45:21.949532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.949509    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.949532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.949532    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.949662 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.949541    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m84pm\" (UniqueName: \"kubernetes.io/projected/6bc4a9b9-25a8-4f9e-8658-ea299bc73713-kube-api-access-m84pm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:45:21.950259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:21.950238    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/auth-test-model-7ef33e-kserve-6d54bd9b6c-2tdnp"]
Jul 15 21:45:22.003136 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:22.003105    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" path="/var/lib/kubelet/pods/6bc4a9b9-25a8-4f9e-8658-ea299bc73713/volumes"
Jul 15 21:45:22.003646 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:22.003628    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" path="/var/lib/kubelet/pods/a34e70df-2bdd-455b-b4dd-0d2897aa8c45/volumes"
Jul 15 21:45:27.206302 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:27.206247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:27.206302 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:27.206309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:27.219036 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:27.219012    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:27.954952 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:27.954920    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:45:44.588240 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588203    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:45:44.588768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588740    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" containerName="main"
Jul 15 21:45:44.588768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588767    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" containerName="main"
Jul 15 21:45:44.588768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588784    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" containerName="main"
Jul 15 21:45:44.588977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588793    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" containerName="main"
Jul 15 21:45:44.588977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588875    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc4a9b9-25a8-4f9e-8658-ea299bc73713" containerName="main"
Jul 15 21:45:44.588977 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.588888    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34e70df-2bdd-455b-b4dd-0d2897aa8c45" containerName="main"
Jul 15 21:45:44.591811 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.591792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.594337 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.594315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"kube-root-ca.crt\""
Jul 15 21:45:44.594337 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.594328    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"default-dockercfg-p57q5\""
Jul 15 21:45:44.594511 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.594343    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"openshift-service-ca.crt\""
Jul 15 21:45:44.594511 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.594329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"sub-test-model-7ef33e-kserve-self-signed-certs\""
Jul 15 21:45:44.601406 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.601385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:45:44.638918 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.638895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrfd\" (UniqueName: \"kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.639023 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.638940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.639066 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.639032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.639104 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.639083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.639139 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.639107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.639176 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.639134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.739953 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.739930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrfd\" (UniqueName: \"kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740068 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.739976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740141 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740181 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740273 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740365 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740520 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740606 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.740679 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.740662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.742365 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.742345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.742448 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.742349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.750491 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.750471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrfd\" (UniqueName: \"kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd\") pod \"sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") " pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:44.901223 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:44.901162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:45.033857 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:45.033798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:45:45.036432 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:45:45.036406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb873bbee_2ce2_4964_8cee_2b506e276828.slice/crio-c46071cb01ff89fb432a5957d56ee40f3fe7b3ea99b74d4065d5bd1fd6473750 WatchSource:0}: Error finding container c46071cb01ff89fb432a5957d56ee40f3fe7b3ea99b74d4065d5bd1fd6473750: Status 404 returned error can't find the container with id c46071cb01ff89fb432a5957d56ee40f3fe7b3ea99b74d4065d5bd1fd6473750
Jul 15 21:45:46.031002 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:46.030959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" event={"ID":"b873bbee-2ce2-4964-8cee-2b506e276828","Type":"ContainerStarted","Data":"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"}
Jul 15 21:45:46.031424 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:46.031015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" event={"ID":"b873bbee-2ce2-4964-8cee-2b506e276828","Type":"ContainerStarted","Data":"c46071cb01ff89fb432a5957d56ee40f3fe7b3ea99b74d4065d5bd1fd6473750"}
Jul 15 21:45:46.050768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:46.050714    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" podStartSLOduration=2.050701411 podStartE2EDuration="2.050701411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:46.049805143 +0000 UTC m=+2366.742711215" watchObservedRunningTime="2026-07-15 21:45:46.050701411 +0000 UTC m=+2366.743607453"
Jul 15 21:45:49.187812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:49.187780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:45:54.901839 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:54.901808    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:54.902209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:54.901854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:54.914265 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:54.914233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:45:55.092167 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:45:55.092122    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:46:03.791166 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:03.791129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:46:20.027592 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:20.027560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:46:20.030788 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:20.030768    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:46:20.037926 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:20.037906    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:46:20.041030 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:20.041014    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lmw6_d77543a0-9337-4635-bfac-fa85c9be1cce/ovn-acl-logging/0.log"
Jul 15 21:46:22.303751 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:22.303710    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:46:23.258346 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:23.258317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:46:25.285307 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:25.285258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:46:27.367013 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.366979    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:46:27.370457 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.370435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.374250 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.374226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fa020c\"/\"rate-test-model-fa020c-kserve-self-signed-certs\""
Jul 15 21:46:27.380664 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.380642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:46:27.401272 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.401403 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.401403 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.401477 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.401515 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.401515 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.401493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qz5\" (UniqueName: \"kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502381 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502501 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502501 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502501 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502501 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502664 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qz5\" (UniqueName: \"kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502825 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502880 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.502920 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.502846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.504787 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.504765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.504944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.504928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.512445 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.512423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qz5\" (UniqueName: \"kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5\") pod \"rate-test-model-fa020c-kserve-7d65c94c79-6prgc\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") " pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.679944 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.679918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:27.812855 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:27.812830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:46:27.815347 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:46:27.815317    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae3e4bfe_b4bf_4935_9793_caf4078543cf.slice/crio-1b7ba961fbbb2d50377533bc2e3e75df19d2518e373be6139758b494fbbc517e WatchSource:0}: Error finding container 1b7ba961fbbb2d50377533bc2e3e75df19d2518e373be6139758b494fbbc517e: Status 404 returned error can't find the container with id 1b7ba961fbbb2d50377533bc2e3e75df19d2518e373be6139758b494fbbc517e
Jul 15 21:46:28.247595 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:28.247563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" event={"ID":"ae3e4bfe-b4bf-4935-9793-caf4078543cf","Type":"ContainerStarted","Data":"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"}
Jul 15 21:46:28.247787 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:28.247603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" event={"ID":"ae3e4bfe-b4bf-4935-9793-caf4078543cf","Type":"ContainerStarted","Data":"1b7ba961fbbb2d50377533bc2e3e75df19d2518e373be6139758b494fbbc517e"}
Jul 15 21:46:28.269068 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:28.269020    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" podStartSLOduration=1.269005785 podStartE2EDuration="1.269005785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:46:28.266638765 +0000 UTC m=+2408.959544834" watchObservedRunningTime="2026-07-15 21:46:28.269005785 +0000 UTC m=+2408.961911826"
Jul 15 21:46:37.323527 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.323480    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" podUID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" containerName="main" containerID="cri-o://40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35" gracePeriod=45
Jul 15 21:46:37.627470 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.627443    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:46:37.680504 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.680467    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:37.680659 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.680522    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:37.686043 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd67g\" (UniqueName: \"kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686161    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm\") pod \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\" (UID: \"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb\") "
Jul 15 21:46:37.686545 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686411    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:37.686545 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686479    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:37.686545 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home" (OuterVolumeSpecName: "home") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:37.686705 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.686683    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:37.688315 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.688270    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:46:37.688436 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.688368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g" (OuterVolumeSpecName: "kube-api-access-hd67g") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "kube-api-access-hd67g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:46:37.688687 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.688672    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm" (OuterVolumeSpecName: "dshm") pod "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" (UID: "6a8555ae-f0fa-4b40-875a-bb6ced68ccfb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:37.697343 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.697320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:37.787500 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.787467    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:37.787500 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.787498    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:37.787685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.787512    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:37.787685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.787525    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd67g\" (UniqueName: \"kubernetes.io/projected/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-kube-api-access-hd67g\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:37.787685 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:37.787539    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.278122 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.278024    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" podUID="b873bbee-2ce2-4964-8cee-2b506e276828" containerName="main" containerID="cri-o://ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1" gracePeriod=45
Jul 15 21:46:38.304574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.304549    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" containerID="40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35" exitCode=0
Jul 15 21:46:38.304693 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.304588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"
Jul 15 21:46:38.304693 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.304628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" event={"ID":"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb","Type":"ContainerDied","Data":"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"}
Jul 15 21:46:38.304693 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.304672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q" event={"ID":"6a8555ae-f0fa-4b40-875a-bb6ced68ccfb","Type":"ContainerDied","Data":"382536e8e7efb42b408a5dbb1a67d8f3e4dacf3dd29cc3858d2d6c7cc4cf0146"}
Jul 15 21:46:38.304854 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.304694    2581 scope.go:117] "RemoveContainer" containerID="40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"
Jul 15 21:46:38.316381 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.316359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:46:38.377432 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.377409    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:46:38.381086 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.381060    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/sub-test-model-fa020c-kserve-6dfbd7f787-nzt9q"]
Jul 15 21:46:38.389833 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.389675    2581 scope.go:117] "RemoveContainer" containerID="40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"
Jul 15 21:46:38.390047 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:46:38.390023    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35\": container with ID starting with 40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35 not found: ID does not exist" containerID="40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"
Jul 15 21:46:38.390097 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.390061    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35"} err="failed to get container status \"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35\": rpc error: code = NotFound desc = could not find container \"40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35\": container with ID starting with 40803eb62c628d9dd92f430571d379e7d362cb18baa12785d2f09d60554abc35 not found: ID does not exist"
Jul 15 21:46:38.532165 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.532104    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:46:38.595013 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.594989    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595026    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595101    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595138    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595169    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zrfd\" (UniqueName: \"kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm\") pod \"b873bbee-2ce2-4964-8cee-2b506e276828\" (UID: \"b873bbee-2ce2-4964-8cee-2b506e276828\") "
Jul 15 21:46:38.595393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595359    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:38.595393 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595370    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home" (OuterVolumeSpecName: "home") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:38.595617 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595425    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache" (OuterVolumeSpecName: "model-cache") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:38.595617 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595552    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.595617 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595572    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.595617 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.595583    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.597158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.597128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:46:38.597327 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.597308    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd" (OuterVolumeSpecName: "kube-api-access-4zrfd") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "kube-api-access-4zrfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:46:38.597411 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.597357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm" (OuterVolumeSpecName: "dshm") pod "b873bbee-2ce2-4964-8cee-2b506e276828" (UID: "b873bbee-2ce2-4964-8cee-2b506e276828"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:46:38.696522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.696497    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zrfd\" (UniqueName: \"kubernetes.io/projected/b873bbee-2ce2-4964-8cee-2b506e276828-kube-api-access-4zrfd\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.696522 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.696521    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b873bbee-2ce2-4964-8cee-2b506e276828-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:38.696663 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:38.696531    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b873bbee-2ce2-4964-8cee-2b506e276828-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:46:39.311279 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.311243    2581 generic.go:356] "Generic (PLEG): container finished" podID="b873bbee-2ce2-4964-8cee-2b506e276828" containerID="ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1" exitCode=0
Jul 15 21:46:39.311473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.311325    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"
Jul 15 21:46:39.311473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.311329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" event={"ID":"b873bbee-2ce2-4964-8cee-2b506e276828","Type":"ContainerDied","Data":"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"}
Jul 15 21:46:39.311473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.311381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc" event={"ID":"b873bbee-2ce2-4964-8cee-2b506e276828","Type":"ContainerDied","Data":"c46071cb01ff89fb432a5957d56ee40f3fe7b3ea99b74d4065d5bd1fd6473750"}
Jul 15 21:46:39.311473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.311399    2581 scope.go:117] "RemoveContainer" containerID="ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"
Jul 15 21:46:39.320728 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.320711    2581 scope.go:117] "RemoveContainer" containerID="ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"
Jul 15 21:46:39.321009 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:46:39.320988    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1\": container with ID starting with ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1 not found: ID does not exist" containerID="ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"
Jul 15 21:46:39.321063 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.321018    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1"} err="failed to get container status \"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1\": rpc error: code = NotFound desc = could not find container \"ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1\": container with ID starting with ab7f9f25f8fe61db32633506bbb14bccbd1a6504ba1db4541cf4edf038a7f4e1 not found: ID does not exist"
Jul 15 21:46:39.333561 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.333531    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:46:39.338141 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:39.338121    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/sub-test-model-7ef33e-kserve-5fc8f5fdb5-lkkhc"]
Jul 15 21:46:40.002888 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:40.002857    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" path="/var/lib/kubelet/pods/6a8555ae-f0fa-4b40-875a-bb6ced68ccfb/volumes"
Jul 15 21:46:40.003328 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:40.003303    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b873bbee-2ce2-4964-8cee-2b506e276828" path="/var/lib/kubelet/pods/b873bbee-2ce2-4964-8cee-2b506e276828/volumes"
Jul 15 21:46:43.580699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:43.580622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:46:50.780894 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.780855    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:46:50.781262 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781245    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" containerName="main"
Jul 15 21:46:50.781262 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" containerName="main"
Jul 15 21:46:50.781371 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781297    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b873bbee-2ce2-4964-8cee-2b506e276828" containerName="main"
Jul 15 21:46:50.781371 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781306    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b873bbee-2ce2-4964-8cee-2b506e276828" containerName="main"
Jul 15 21:46:50.781436 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781387    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a8555ae-f0fa-4b40-875a-bb6ced68ccfb" containerName="main"
Jul 15 21:46:50.781436 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.781398    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b873bbee-2ce2-4964-8cee-2b506e276828" containerName="main"
Jul 15 21:46:50.786136 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.786116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.788699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.788674    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"default-dockercfg-p57q5\""
Jul 15 21:46:50.788699 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.788691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"rate-test-model-7ef33e-kserve-self-signed-certs\""
Jul 15 21:46:50.788884 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.788674    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"kube-root-ca.crt\""
Jul 15 21:46:50.788884 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.788723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7ef33e\"/\"openshift-service-ca.crt\""
Jul 15 21:46:50.795411 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.795387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:46:50.895431 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.895678 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.895678 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.895678 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.895843 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.895843 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.895714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvx2q\" (UniqueName: \"kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.996847 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.996822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.996987 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.996860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.996987 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.996964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvx2q\" (UniqueName: \"kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997144 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997144 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997251 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997334 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997482 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.997647 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.997625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:50.999224 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.999195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:51.007072 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:50.999739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:51.009950 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.009924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvx2q\" (UniqueName: \"kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q\") pod \"rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") " pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:51.096760 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.096699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:46:51.236968 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.236895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:46:51.239887 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:46:51.239861    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb91239f3_ced5_425d_b13d_d6c1cd41a646.slice/crio-65626b88dccb80d4f0df0e62fee7f6eb40f3ec28161f16036e676701f2bd264d WatchSource:0}: Error finding container 65626b88dccb80d4f0df0e62fee7f6eb40f3ec28161f16036e676701f2bd264d: Status 404 returned error can't find the container with id 65626b88dccb80d4f0df0e62fee7f6eb40f3ec28161f16036e676701f2bd264d
Jul 15 21:46:51.380762 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.380685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" event={"ID":"b91239f3-ced5-425d-b13d-d6c1cd41a646","Type":"ContainerStarted","Data":"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"}
Jul 15 21:46:51.380762 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.380727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" event={"ID":"b91239f3-ced5-425d-b13d-d6c1cd41a646","Type":"ContainerStarted","Data":"65626b88dccb80d4f0df0e62fee7f6eb40f3ec28161f16036e676701f2bd264d"}
Jul 15 21:46:51.400095 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:51.400054    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" podStartSLOduration=1.400038565 podStartE2EDuration="1.400038565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:46:51.398620823 +0000 UTC m=+2432.091526868" watchObservedRunningTime="2026-07-15 21:46:51.400038565 +0000 UTC m=+2432.092944608"
Jul 15 21:46:55.682248 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:46:55.682210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:47:01.097000 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:01.096963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:01.097463 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:01.097205    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:01.109683 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:01.109660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:01.444955 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:01.444930    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:10.382301 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:10.382253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:47:28.875472 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:28.875437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:47:36.620233 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:36.620185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:47:37.609684 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:37.609655    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:47:38.555776 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.555735    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139900074913456"]
Jul 15 21:47:38.559197 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.559177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:38.561100 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.561081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncn7w\""
Jul 15 21:47:38.566765 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.566745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900074913456"]
Jul 15 21:47:38.590618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.590596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72br\" (UniqueName: \"kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br\") pod \"test-curl-7447-139900074913456\" (UID: \"a92e73ee-421e-4b29-b5dc-79c4896a3061\") " pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:38.691274 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.691246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72br\" (UniqueName: \"kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br\") pod \"test-curl-7447-139900074913456\" (UID: \"a92e73ee-421e-4b29-b5dc-79c4896a3061\") " pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:38.699929 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.699905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72br\" (UniqueName: \"kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br\") pod \"test-curl-7447-139900074913456\" (UID: \"a92e73ee-421e-4b29-b5dc-79c4896a3061\") " pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:38.869513 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:38.869444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:39.002233 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:39.000896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900074913456"]
Jul 15 21:47:39.004798 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:39.004773    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:47:39.643525 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:39.643488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900074913456" event={"ID":"a92e73ee-421e-4b29-b5dc-79c4896a3061","Type":"ContainerStarted","Data":"6bdfe66868d68073cd9fa9253a2d51543837136961c51dab37352892a9b84bf9"}
Jul 15 21:47:40.649829 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:40.649794    2581 generic.go:356] "Generic (PLEG): container finished" podID="a92e73ee-421e-4b29-b5dc-79c4896a3061" containerID="3ca96adfe0561dd33ea13632eec93d7f528db3420fefb5a568893ca4dc98c912" exitCode=0
Jul 15 21:47:40.650248 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:40.649837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900074913456" event={"ID":"a92e73ee-421e-4b29-b5dc-79c4896a3061","Type":"ContainerDied","Data":"3ca96adfe0561dd33ea13632eec93d7f528db3420fefb5a568893ca4dc98c912"}
Jul 15 21:47:41.788108 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.788081    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:41.827206 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.827178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d72br\" (UniqueName: \"kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br\") pod \"a92e73ee-421e-4b29-b5dc-79c4896a3061\" (UID: \"a92e73ee-421e-4b29-b5dc-79c4896a3061\") "
Jul 15 21:47:41.829277 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.829255    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br" (OuterVolumeSpecName: "kube-api-access-d72br") pod "a92e73ee-421e-4b29-b5dc-79c4896a3061" (UID: "a92e73ee-421e-4b29-b5dc-79c4896a3061"). InnerVolumeSpecName "kube-api-access-d72br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:41.835248 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.835218    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139900074913456_a92e73ee-421e-4b29-b5dc-79c4896a3061/test-curl-7447-139900074913456/0.log"
Jul 15 21:47:41.869665 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.869638    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139900074913456"]
Jul 15 21:47:41.879225 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.879204    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139900074913456"]
Jul 15 21:47:41.928618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:41.928598    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d72br\" (UniqueName: \"kubernetes.io/projected/a92e73ee-421e-4b29-b5dc-79c4896a3061-kube-api-access-d72br\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:42.003071 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:42.003036    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a92e73ee-421e-4b29-b5dc-79c4896a3061" path="/var/lib/kubelet/pods/a92e73ee-421e-4b29-b5dc-79c4896a3061/volumes"
Jul 15 21:47:42.665318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:42.665276    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900074913456"
Jul 15 21:47:42.665473 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:42.665331    2581 scope.go:117] "RemoveContainer" containerID="3ca96adfe0561dd33ea13632eec93d7f528db3420fefb5a568893ca4dc98c912"
Jul 15 21:47:43.481415 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:43.481378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:47:48.276922 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.276883    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139900075079408"]
Jul 15 21:47:48.277443 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.277423    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e73ee-421e-4b29-b5dc-79c4896a3061" containerName="test-curl-7447-139900074913456"
Jul 15 21:47:48.277519 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.277445    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e73ee-421e-4b29-b5dc-79c4896a3061" containerName="test-curl-7447-139900074913456"
Jul 15 21:47:48.277581 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.277571    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a92e73ee-421e-4b29-b5dc-79c4896a3061" containerName="test-curl-7447-139900074913456"
Jul 15 21:47:48.282020 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.281997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:48.284112 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.284087    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncn7w\""
Jul 15 21:47:48.285074 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.285051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900075079408"]
Jul 15 21:47:48.382513 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.382486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrsr\" (UniqueName: \"kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr\") pod \"test-curl-7447-139900075079408\" (UID: \"4c1a4a08-bd59-4f57-aee0-b71c39b217ba\") " pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:48.483618 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.483590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrsr\" (UniqueName: \"kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr\") pod \"test-curl-7447-139900075079408\" (UID: \"4c1a4a08-bd59-4f57-aee0-b71c39b217ba\") " pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:48.493142 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.493112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrsr\" (UniqueName: \"kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr\") pod \"test-curl-7447-139900075079408\" (UID: \"4c1a4a08-bd59-4f57-aee0-b71c39b217ba\") " pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:48.591720 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.591662    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:48.723949 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:48.723926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900075079408"]
Jul 15 21:47:48.726147 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:47:48.726119    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c1a4a08_bd59_4f57_aee0_b71c39b217ba.slice/crio-47849d7cd7b29278274671c53345fa327b93ef59a7d679c4fa832bd79e53c608 WatchSource:0}: Error finding container 47849d7cd7b29278274671c53345fa327b93ef59a7d679c4fa832bd79e53c608: Status 404 returned error can't find the container with id 47849d7cd7b29278274671c53345fa327b93ef59a7d679c4fa832bd79e53c608
Jul 15 21:47:49.704954 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:49.704920    2581 generic.go:356] "Generic (PLEG): container finished" podID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" containerID="655fee7c1bf077b6c53613aec934797dabccb033b274ed66940c397af7a851ba" exitCode=0
Jul 15 21:47:49.705329 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:49.704997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900075079408" event={"ID":"4c1a4a08-bd59-4f57-aee0-b71c39b217ba","Type":"ContainerDied","Data":"655fee7c1bf077b6c53613aec934797dabccb033b274ed66940c397af7a851ba"}
Jul 15 21:47:49.705329 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:49.705025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900075079408" event={"ID":"4c1a4a08-bd59-4f57-aee0-b71c39b217ba","Type":"ContainerStarted","Data":"47849d7cd7b29278274671c53345fa327b93ef59a7d679c4fa832bd79e53c608"}
Jul 15 21:47:50.846793 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.846768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:50.869795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.869774    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139900075079408_4c1a4a08-bd59-4f57-aee0-b71c39b217ba/test-curl-7447-139900075079408/0.log"
Jul 15 21:47:50.900202 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.898078    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139900075079408"]
Jul 15 21:47:50.904860 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.904833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgrsr\" (UniqueName: \"kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr\") pod \"4c1a4a08-bd59-4f57-aee0-b71c39b217ba\" (UID: \"4c1a4a08-bd59-4f57-aee0-b71c39b217ba\") "
Jul 15 21:47:50.905465 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.905443    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139900075079408"]
Jul 15 21:47:50.906931 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:50.906907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr" (OuterVolumeSpecName: "kube-api-access-sgrsr") pod "4c1a4a08-bd59-4f57-aee0-b71c39b217ba" (UID: "4c1a4a08-bd59-4f57-aee0-b71c39b217ba"). InnerVolumeSpecName "kube-api-access-sgrsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:51.006318 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:51.006246    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgrsr\" (UniqueName: \"kubernetes.io/projected/4c1a4a08-bd59-4f57-aee0-b71c39b217ba-kube-api-access-sgrsr\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:51.646182 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:51.646121    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" podUID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" containerName="main" containerID="cri-o://5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8" gracePeriod=45
Jul 15 21:47:51.716570 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:51.716548    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:51.716669 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:51.716577    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47849d7cd7b29278274671c53345fa327b93ef59a7d679c4fa832bd79e53c608"
Jul 15 21:47:51.726553 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:47:51.726527    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-139900075079408\" is forbidden: User \"system:node:ip-10-0-129-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-60.ec2.internal' and this object" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:51.903503 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:51.903447    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:47:51.905437 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:47:51.905410    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-139900075079408\" is forbidden: User \"system:node:ip-10-0-129-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-60.ec2.internal' and this object" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" pod="opendatahub/test-curl-7447-139900075079408"
Jul 15 21:47:52.004326 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.004270    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" path="/var/lib/kubelet/pods/4c1a4a08-bd59-4f57-aee0-b71c39b217ba/volumes"
Jul 15 21:47:52.017373 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017496 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017708 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8qz5\" (UniqueName: \"kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5\") pod \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\" (UID: \"ae3e4bfe-b4bf-4935-9793-caf4078543cf\") "
Jul 15 21:47:52.017708 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:52.017708 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home" (OuterVolumeSpecName: "home") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:52.017838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:52.017838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017768    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.017838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.017790    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.019665 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.019627    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm" (OuterVolumeSpecName: "dshm") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:52.019767 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.019674    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:47:52.019767 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.019695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5" (OuterVolumeSpecName: "kube-api-access-d8qz5") pod "ae3e4bfe-b4bf-4935-9793-caf4078543cf" (UID: "ae3e4bfe-b4bf-4935-9793-caf4078543cf"). InnerVolumeSpecName "kube-api-access-d8qz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:52.118930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.118900    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8qz5\" (UniqueName: \"kubernetes.io/projected/ae3e4bfe-b4bf-4935-9793-caf4078543cf-kube-api-access-d8qz5\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.118930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.118923    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.118930 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.118933    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae3e4bfe-b4bf-4935-9793-caf4078543cf-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.119150 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.118941    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae3e4bfe-b4bf-4935-9793-caf4078543cf-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:52.632244 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.632192    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" podUID="b91239f3-ced5-425d-b13d-d6c1cd41a646" containerName="main" containerID="cri-o://7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed" gracePeriod=45
Jul 15 21:47:52.723368 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.723333    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" containerID="5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8" exitCode=0
Jul 15 21:47:52.723505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.723375    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"
Jul 15 21:47:52.723505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.723386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" event={"ID":"ae3e4bfe-b4bf-4935-9793-caf4078543cf","Type":"ContainerDied","Data":"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"}
Jul 15 21:47:52.723505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.723427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc" event={"ID":"ae3e4bfe-b4bf-4935-9793-caf4078543cf","Type":"ContainerDied","Data":"1b7ba961fbbb2d50377533bc2e3e75df19d2518e373be6139758b494fbbc517e"}
Jul 15 21:47:52.723505 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.723461    2581 scope.go:117] "RemoveContainer" containerID="5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"
Jul 15 21:47:52.743220 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.743200    2581 scope.go:117] "RemoveContainer" containerID="5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"
Jul 15 21:47:52.743589 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:47:52.743566    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8\": container with ID starting with 5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8 not found: ID does not exist" containerID="5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"
Jul 15 21:47:52.743677 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.743596    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8"} err="failed to get container status \"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8\": rpc error: code = NotFound desc = could not find container \"5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8\": container with ID starting with 5760e6591705d68ccf664dc86d105253d7454983ea9ca55232b701237b6ea2d8 not found: ID does not exist"
Jul 15 21:47:52.747275 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.747249    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:47:52.751994 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.751975    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fa020c/rate-test-model-fa020c-kserve-7d65c94c79-6prgc"]
Jul 15 21:47:52.868130 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:52.868096    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:53.026257 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvx2q\" (UniqueName: \"kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026416    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026459    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm\") pod \"b91239f3-ced5-425d-b13d-d6c1cd41a646\" (UID: \"b91239f3-ced5-425d-b13d-d6c1cd41a646\") "
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:53.026700 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026683    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache" (OuterVolumeSpecName: "model-cache") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:53.027002 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.026700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home" (OuterVolumeSpecName: "home") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:53.028378 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.028356    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:47:53.028838 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.028816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm" (OuterVolumeSpecName: "dshm") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:53.028881 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.028832    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q" (OuterVolumeSpecName: "kube-api-access-lvx2q") pod "b91239f3-ced5-425d-b13d-d6c1cd41a646" (UID: "b91239f3-ced5-425d-b13d-d6c1cd41a646"). InnerVolumeSpecName "kube-api-access-lvx2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:53.127371 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127342    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-model-cache\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.127371 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127368    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-dshm\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.127530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127381    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvx2q\" (UniqueName: \"kubernetes.io/projected/b91239f3-ced5-425d-b13d-d6c1cd41a646-kube-api-access-lvx2q\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.127530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127395    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b91239f3-ced5-425d-b13d-d6c1cd41a646-tls-certs\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.127530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127407    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-tmp-dir\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.127530 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.127417    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b91239f3-ced5-425d-b13d-d6c1cd41a646-home\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:53.316657 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.316628    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139900075080416"]
Jul 15 21:47:53.317013 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.316999    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" containerName="test-curl-7447-139900075079408"
Jul 15 21:47:53.317075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317015    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" containerName="test-curl-7447-139900075079408"
Jul 15 21:47:53.317075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317027    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" containerName="main"
Jul 15 21:47:53.317075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317035    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" containerName="main"
Jul 15 21:47:53.317075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317052    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91239f3-ced5-425d-b13d-d6c1cd41a646" containerName="main"
Jul 15 21:47:53.317075 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317058    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91239f3-ced5-425d-b13d-d6c1cd41a646" containerName="main"
Jul 15 21:47:53.317221 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317120    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1a4a08-bd59-4f57-aee0-b71c39b217ba" containerName="test-curl-7447-139900075079408"
Jul 15 21:47:53.317221 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317131    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" containerName="main"
Jul 15 21:47:53.317221 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.317137    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91239f3-ced5-425d-b13d-d6c1cd41a646" containerName="main"
Jul 15 21:47:53.320384 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.320368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:53.323660 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.323636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncn7w\""
Jul 15 21:47:53.335023 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.334999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900075080416"]
Jul 15 21:47:53.429684 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.429648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xktn7\" (UniqueName: \"kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7\") pod \"test-curl-7447-139900075080416\" (UID: \"525cbdf7-db74-4e01-b256-fdc62693c0d8\") " pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:53.531099 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.531069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xktn7\" (UniqueName: \"kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7\") pod \"test-curl-7447-139900075080416\" (UID: \"525cbdf7-db74-4e01-b256-fdc62693c0d8\") " pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:53.542996 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.542971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xktn7\" (UniqueName: \"kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7\") pod \"test-curl-7447-139900075080416\" (UID: \"525cbdf7-db74-4e01-b256-fdc62693c0d8\") " pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:53.629136 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.629077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:53.731540 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.731505    2581 generic.go:356] "Generic (PLEG): container finished" podID="b91239f3-ced5-425d-b13d-d6c1cd41a646" containerID="7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed" exitCode=0
Jul 15 21:47:53.731676 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.731547    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"
Jul 15 21:47:53.731676 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.731559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" event={"ID":"b91239f3-ced5-425d-b13d-d6c1cd41a646","Type":"ContainerDied","Data":"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"}
Jul 15 21:47:53.731676 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.731602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr" event={"ID":"b91239f3-ced5-425d-b13d-d6c1cd41a646","Type":"ContainerDied","Data":"65626b88dccb80d4f0df0e62fee7f6eb40f3ec28161f16036e676701f2bd264d"}
Jul 15 21:47:53.731676 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.731628    2581 scope.go:117] "RemoveContainer" containerID="7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"
Jul 15 21:47:53.742572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.741946    2581 scope.go:117] "RemoveContainer" containerID="7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"
Jul 15 21:47:53.742572 ip-10-0-129-60 kubenswrapper[2581]: E0715 21:47:53.742342    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed\": container with ID starting with 7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed not found: ID does not exist" containerID="7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"
Jul 15 21:47:53.742572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.742374    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed"} err="failed to get container status \"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed\": rpc error: code = NotFound desc = could not find container \"7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed\": container with ID starting with 7001242f54a8e2d0e97a5096481bcd7acc46607c2b5b5d40a0cf86f92f260fed not found: ID does not exist"
Jul 15 21:47:53.757251 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.757229    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:47:53.761196 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.761169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139900075080416"]
Jul 15 21:47:53.763512 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:47:53.763489    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod525cbdf7_db74_4e01_b256_fdc62693c0d8.slice/crio-04fc829257ea8df9140c127f66709aa40874302fa89e81c129cdc4eeb7ec1a1c WatchSource:0}: Error finding container 04fc829257ea8df9140c127f66709aa40874302fa89e81c129cdc4eeb7ec1a1c: Status 404 returned error can't find the container with id 04fc829257ea8df9140c127f66709aa40874302fa89e81c129cdc4eeb7ec1a1c
Jul 15 21:47:53.764999 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:53.764979    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7ef33e/rate-test-model-7ef33e-kserve-7d5b85bbdc-j4ddr"]
Jul 15 21:47:54.014361 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:54.006364    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3e4bfe-b4bf-4935-9793-caf4078543cf" path="/var/lib/kubelet/pods/ae3e4bfe-b4bf-4935-9793-caf4078543cf/volumes"
Jul 15 21:47:54.014361 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:54.006967    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91239f3-ced5-425d-b13d-d6c1cd41a646" path="/var/lib/kubelet/pods/b91239f3-ced5-425d-b13d-d6c1cd41a646/volumes"
Jul 15 21:47:54.737782 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:54.737747    2581 generic.go:356] "Generic (PLEG): container finished" podID="525cbdf7-db74-4e01-b256-fdc62693c0d8" containerID="e93901465644c02b4a0e689fe51b104574d20615f7c22616679415c1358ebdfe" exitCode=0
Jul 15 21:47:54.738175 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:54.737837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900075080416" event={"ID":"525cbdf7-db74-4e01-b256-fdc62693c0d8","Type":"ContainerDied","Data":"e93901465644c02b4a0e689fe51b104574d20615f7c22616679415c1358ebdfe"}
Jul 15 21:47:54.738175 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:54.737878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139900075080416" event={"ID":"525cbdf7-db74-4e01-b256-fdc62693c0d8","Type":"ContainerStarted","Data":"04fc829257ea8df9140c127f66709aa40874302fa89e81c129cdc4eeb7ec1a1c"}
Jul 15 21:47:55.880881 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.880854    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:47:55.902814 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.902794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139900075080416_525cbdf7-db74-4e01-b256-fdc62693c0d8/test-curl-7447-139900075080416/0.log"
Jul 15 21:47:55.930508 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.930480    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139900075080416"]
Jul 15 21:47:55.935196 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.935176    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139900075080416"]
Jul 15 21:47:55.949359 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.949341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xktn7\" (UniqueName: \"kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7\") pod \"525cbdf7-db74-4e01-b256-fdc62693c0d8\" (UID: \"525cbdf7-db74-4e01-b256-fdc62693c0d8\") "
Jul 15 21:47:55.951338 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:55.951319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7" (OuterVolumeSpecName: "kube-api-access-xktn7") pod "525cbdf7-db74-4e01-b256-fdc62693c0d8" (UID: "525cbdf7-db74-4e01-b256-fdc62693c0d8"). InnerVolumeSpecName "kube-api-access-xktn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:56.002796 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:56.002735    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="525cbdf7-db74-4e01-b256-fdc62693c0d8" path="/var/lib/kubelet/pods/525cbdf7-db74-4e01-b256-fdc62693c0d8/volumes"
Jul 15 21:47:56.049968 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:56.049942    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xktn7\" (UniqueName: \"kubernetes.io/projected/525cbdf7-db74-4e01-b256-fdc62693c0d8-kube-api-access-xktn7\") on node \"ip-10-0-129-60.ec2.internal\" DevicePath \"\""
Jul 15 21:47:56.750101 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:56.750072    2581 scope.go:117] "RemoveContainer" containerID="e93901465644c02b4a0e689fe51b104574d20615f7c22616679415c1358ebdfe"
Jul 15 21:47:56.750250 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:47:56.750084    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139900075080416"
Jul 15 21:48:05.988888 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:05.988845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:48:19.383430 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:19.383345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pwsjw"]
Jul 15 21:48:23.799012 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:23.798980    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b564d89b5-hc9sr_b11d3359-11ca-4172-98c3-528dc2ab6b9e/authorino/0.log"
Jul 15 21:48:29.969622 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:29.969586    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-8kjnl_bd16b2cd-5a45-4f2c-8472-0745904e6575/copy-manifests/0.log"
Jul 15 21:48:29.977484 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:29.977465    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-8kjnl_bd16b2cd-5a45-4f2c-8472-0745904e6575/manager/0.log"
Jul 15 21:48:31.735973 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.735943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/util/0.log"
Jul 15 21:48:31.744577 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.744554    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/pull/0.log"
Jul 15 21:48:31.753364 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.753345    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/extract/0.log"
Jul 15 21:48:31.870304 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.870259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/extract/0.log"
Jul 15 21:48:31.878476 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.878456    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/util/0.log"
Jul 15 21:48:31.886139 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:31.886117    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/pull/0.log"
Jul 15 21:48:32.003906 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.003844    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/util/0.log"
Jul 15 21:48:32.011913 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.011894    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/pull/0.log"
Jul 15 21:48:32.019882 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.019868    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/extract/0.log"
Jul 15 21:48:32.135271 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.135248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/util/0.log"
Jul 15 21:48:32.142812 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.142796    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/pull/0.log"
Jul 15 21:48:32.150922 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.150904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/extract/0.log"
Jul 15 21:48:32.263795 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.263730    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b564d89b5-hc9sr_b11d3359-11ca-4172-98c3-528dc2ab6b9e/authorino/0.log"
Jul 15 21:48:32.984964 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:32.984927    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pwsjw_004ebb16-85b8-41ed-b3d4-88ca99e440ee/limitador/0.log"
Jul 15 21:48:33.716788 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:33.716761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bcb5978cd-gkqfv_945a6a4b-a3b7-4122-8c5a-4bc8531af02d/kube-auth-proxy/0.log"
Jul 15 21:48:34.305564 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:34.305514    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6547f5d7b6-qlhfc_db887899-543c-44a1-92af-f0b649be473d/router/0.log"
Jul 15 21:48:34.777304 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:34.777259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-lx4xh_06ba5b44-d343-4e2c-a283-7e1bc4a2e1bc/main/0.log"
Jul 15 21:48:35.238520 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:35.238495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-8lfqr_99f2e12d-07fd-4e7b-a53d-1031a1f188c7/main/0.log"
Jul 15 21:48:40.918917 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.918880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-546bh/must-gather-xtf6j"]
Jul 15 21:48:40.919574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.919222    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="525cbdf7-db74-4e01-b256-fdc62693c0d8" containerName="test-curl-7447-139900075080416"
Jul 15 21:48:40.919574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.919233    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="525cbdf7-db74-4e01-b256-fdc62693c0d8" containerName="test-curl-7447-139900075080416"
Jul 15 21:48:40.919574 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.919307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="525cbdf7-db74-4e01-b256-fdc62693c0d8" containerName="test-curl-7447-139900075080416"
Jul 15 21:48:40.922469 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.922450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:40.924715 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.924695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-546bh\"/\"default-dockercfg-fkhhx\""
Jul 15 21:48:40.924840 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.924805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-546bh\"/\"kube-root-ca.crt\""
Jul 15 21:48:40.924901 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.924805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-546bh\"/\"openshift-service-ca.crt\""
Jul 15 21:48:40.933090 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:40.933070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/must-gather-xtf6j"]
Jul 15 21:48:41.035441 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.035409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-must-gather-output\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.035572 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.035538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdfr\" (UniqueName: \"kubernetes.io/projected/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-kube-api-access-xwdfr\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.136694 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.136663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdfr\" (UniqueName: \"kubernetes.io/projected/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-kube-api-access-xwdfr\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.136836 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.136710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-must-gather-output\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.137205 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.137171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-must-gather-output\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.148299 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.148265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdfr\" (UniqueName: \"kubernetes.io/projected/d8107d2e-e89d-4c85-81b3-1e24b33ffa08-kube-api-access-xwdfr\") pod \"must-gather-xtf6j\" (UID: \"d8107d2e-e89d-4c85-81b3-1e24b33ffa08\") " pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.232679 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.232655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/must-gather-xtf6j"
Jul 15 21:48:41.362675 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.362650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/must-gather-xtf6j"]
Jul 15 21:48:41.364736 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:48:41.364713    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8107d2e_e89d_4c85_81b3_1e24b33ffa08.slice/crio-39bf4081b536869cd41228addeb7bc56e7f0afe7f808aa64b7a99645501caef4 WatchSource:0}: Error finding container 39bf4081b536869cd41228addeb7bc56e7f0afe7f808aa64b7a99645501caef4: Status 404 returned error can't find the container with id 39bf4081b536869cd41228addeb7bc56e7f0afe7f808aa64b7a99645501caef4
Jul 15 21:48:41.982094 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:41.982061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/must-gather-xtf6j" event={"ID":"d8107d2e-e89d-4c85-81b3-1e24b33ffa08","Type":"ContainerStarted","Data":"39bf4081b536869cd41228addeb7bc56e7f0afe7f808aa64b7a99645501caef4"}
Jul 15 21:48:42.992638 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:42.992593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/must-gather-xtf6j" event={"ID":"d8107d2e-e89d-4c85-81b3-1e24b33ffa08","Type":"ContainerStarted","Data":"29c32f3a0bc9848b2a89c2ba012e3332c8e95070063a5051452f9a9fa0fa34d8"}
Jul 15 21:48:42.993158 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:42.992654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/must-gather-xtf6j" event={"ID":"d8107d2e-e89d-4c85-81b3-1e24b33ffa08","Type":"ContainerStarted","Data":"e5d0997d62acbe6d0116fae4cfb348491eff75dc42d9470abe883bd36be9ac98"}
Jul 15 21:48:43.009875 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:43.009829    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-546bh/must-gather-xtf6j" podStartSLOduration=2.112520788 podStartE2EDuration="3.009812034s" totalImagesPullingTime="897.291246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:43.008130626 +0000 UTC m=+2543.701036669" watchObservedRunningTime="2026-07-15 21:48:43.009812034 +0000 UTC m=+2543.702718077"
Jul 15 21:48:43.926210 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:43.926179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qv9r5_07054f71-c3a8-4f1b-bee5-c7977c1a15ab/global-pull-secret-syncer/0.log"
Jul 15 21:48:44.109324 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:44.109272    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfhqz_dc4394de-b0de-4efc-aa0b-693780465668/konnectivity-agent/0.log"
Jul 15 21:48:44.162269 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:44.162239    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-60.ec2.internal_5f07e2ab30e2e8e91d0c170973cc72aa/haproxy/0.log"
Jul 15 21:48:48.131396 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.131363    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/extract/0.log"
Jul 15 21:48:48.163082 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.163049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/util/0.log"
Jul 15 21:48:48.192117 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.192080    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2mdl_826dd2d9-f312-49ff-8d98-05c768ebf23e/pull/0.log"
Jul 15 21:48:48.235031 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.234990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/extract/0.log"
Jul 15 21:48:48.268561 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.268534    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/util/0.log"
Jul 15 21:48:48.301099 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.301070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gmvqg_0c400c3e-791a-4a29-a2ee-56ffb9d0aa23/pull/0.log"
Jul 15 21:48:48.336978 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.336939    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/extract/0.log"
Jul 15 21:48:48.370041 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.370012    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/util/0.log"
Jul 15 21:48:48.400192 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.400095    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mqljv_990cd37d-23cf-4d6b-85d2-f2e3c756781e/pull/0.log"
Jul 15 21:48:48.433429 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.433401    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/extract/0.log"
Jul 15 21:48:48.460712 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.460671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/util/0.log"
Jul 15 21:48:48.492163 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.492131    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16f6rl_e63b2ade-109d-4833-ac75-b77b4e162781/pull/0.log"
Jul 15 21:48:48.924305 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:48.924060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b564d89b5-hc9sr_b11d3359-11ca-4172-98c3-528dc2ab6b9e/authorino/0.log"
Jul 15 21:48:49.206474 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:49.206436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pwsjw_004ebb16-85b8-41ed-b3d4-88ca99e440ee/limitador/0.log"
Jul 15 21:48:51.216371 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.216339    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-smrhb_43378288-071e-480b-a104-4f2550a04243/cluster-monitoring-operator/0.log"
Jul 15 21:48:51.358922 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.358878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84c79f7c68-nljwd_f01d1428-9b5c-4529-9368-4406a3b4b38c/metrics-server/0.log"
Jul 15 21:48:51.398547 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.398468    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6p95x_daab27e2-cc06-411a-b9eb-9a864e7b33a0/monitoring-plugin/0.log"
Jul 15 21:48:51.646439 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.646409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrdxc_5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4/node-exporter/0.log"
Jul 15 21:48:51.681680 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.681646    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrdxc_5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4/kube-rbac-proxy/0.log"
Jul 15 21:48:51.714256 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:51.714209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrdxc_5e1cc39d-c2bf-4fc6-b6c9-c3217ae3fbe4/init-textfile/0.log"
Jul 15 21:48:52.251706 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.251680    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/thanos-query/0.log"
Jul 15 21:48:52.279806 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.279749    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/kube-rbac-proxy-web/0.log"
Jul 15 21:48:52.306532 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.306505    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/kube-rbac-proxy/0.log"
Jul 15 21:48:52.334177 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.334140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/prom-label-proxy/0.log"
Jul 15 21:48:52.362775 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.362748    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/kube-rbac-proxy-rules/0.log"
Jul 15 21:48:52.389468 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:52.389438    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8779b9b4-c2hhz_380ffa19-a639-4c56-84e3-4ee5a00b39a6/kube-rbac-proxy-metrics/0.log"
Jul 15 21:48:54.123762 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.123718    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"]
Jul 15 21:48:54.132519 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.132488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.136789 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.136750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"]
Jul 15 21:48:54.299003 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.298956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-lib-modules\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.299302 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.299259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-sys\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.299470 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.299452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-podres\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.299678 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.299661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrxm\" (UniqueName: \"kubernetes.io/projected/1083a3e9-bfa7-4870-a447-26cdd07268d1-kube-api-access-rvrxm\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.299858 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.299842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-proc\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.368020 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.367991    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/2.log"
Jul 15 21:48:54.374123 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.374050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zmvlv_cb21e43a-08ca-42d3-9faa-903a5290ea4b/console-operator/3.log"
Jul 15 21:48:54.400529 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.400497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-proc\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.400829 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.400629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-proc\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401016 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.400813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-lib-modules\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401209 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.400948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-lib-modules\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401390 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.401363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-sys\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401479 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.401164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-sys\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401587 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.401571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-podres\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.401760 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.401746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrxm\" (UniqueName: \"kubernetes.io/projected/1083a3e9-bfa7-4870-a447-26cdd07268d1-kube-api-access-rvrxm\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.402243 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.402223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1083a3e9-bfa7-4870-a447-26cdd07268d1-podres\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.412459 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.412433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrxm\" (UniqueName: \"kubernetes.io/projected/1083a3e9-bfa7-4870-a447-26cdd07268d1-kube-api-access-rvrxm\") pod \"perf-node-gather-daemonset-l8ws4\" (UID: \"1083a3e9-bfa7-4870-a447-26cdd07268d1\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.447360 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.447325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:54.654814 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:54.654172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"]
Jul 15 21:48:54.661850 ip-10-0-129-60 kubenswrapper[2581]: W0715 21:48:54.661798    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1083a3e9_bfa7_4870_a447_26cdd07268d1.slice/crio-5a18d30f6ab7d1d56c458b33ba2abd4ba3d237035bc7a7839a96de41b67da6db WatchSource:0}: Error finding container 5a18d30f6ab7d1d56c458b33ba2abd4ba3d237035bc7a7839a96de41b67da6db: Status 404 returned error can't find the container with id 5a18d30f6ab7d1d56c458b33ba2abd4ba3d237035bc7a7839a96de41b67da6db
Jul 15 21:48:55.033487 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.033455    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7947cfc8f4-bc6hr_819a891d-d8c4-4244-835d-b2365604f4dd/console/0.log"
Jul 15 21:48:55.092329 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.092273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4" event={"ID":"1083a3e9-bfa7-4870-a447-26cdd07268d1","Type":"ContainerStarted","Data":"46acf02b748a8a1bec50b05f5b6df89226c7d16c4c6aba1b0ec30c55f417bf35"}
Jul 15 21:48:55.092470 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.092351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4" event={"ID":"1083a3e9-bfa7-4870-a447-26cdd07268d1","Type":"ContainerStarted","Data":"5a18d30f6ab7d1d56c458b33ba2abd4ba3d237035bc7a7839a96de41b67da6db"}
Jul 15 21:48:55.092602 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.092580    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:48:55.093668 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.093650    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-vfmh4_0c6ff558-19ac-4263-8e7c-508e3bf837f8/download-server/0.log"
Jul 15 21:48:55.112027 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.111982    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4" podStartSLOduration=1.111967601 podStartE2EDuration="1.111967601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:55.110019213 +0000 UTC m=+2555.802925256" watchObservedRunningTime="2026-07-15 21:48:55.111967601 +0000 UTC m=+2555.804873637"
Jul 15 21:48:55.728038 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:55.728010    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-4jncp_1255b2fb-1ef8-4f0a-8d98-c593cc111992/volume-data-source-validator/0.log"
Jul 15 21:48:57.047056 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:57.047027    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q6phd_7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d/dns/0.log"
Jul 15 21:48:57.084720 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:57.084680    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q6phd_7db3c46a-f8f5-4f8b-830a-c4c2c2fa244d/kube-rbac-proxy/0.log"
Jul 15 21:48:57.206418 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:57.206378    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw2nw_b878c29b-cb43-44bd-88e8-989972702c34/dns-node-resolver/0.log"
Jul 15 21:48:57.883897 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:57.883853    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xtlrx_57d855b3-769d-428f-8ed8-d4c611187e0d/node-ca/0.log"
Jul 15 21:48:59.045718 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:59.045686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bcb5978cd-gkqfv_945a6a4b-a3b7-4122-8c5a-4bc8531af02d/kube-auth-proxy/0.log"
Jul 15 21:48:59.232768 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:59.232744    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6547f5d7b6-qlhfc_db887899-543c-44a1-92af-f0b649be473d/router/0.log"
Jul 15 21:48:59.969650 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:48:59.969621    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cpj54_572382a0-06b2-49c3-a09c-23df0a6baea2/serve-healthcheck-canary/0.log"
Jul 15 21:49:00.496805 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:00.496773    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jsl4p_5c50e517-86eb-4424-9c60-1054353518ea/insights-operator/0.log"
Jul 15 21:49:00.499259 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:00.499238    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jsl4p_5c50e517-86eb-4424-9c60-1054353518ea/insights-operator/1.log"
Jul 15 21:49:00.613915 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:00.613881    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fz8kj_77c1794b-219c-4908-964a-e615cca6ad41/kube-rbac-proxy/0.log"
Jul 15 21:49:00.642403 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:00.642375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fz8kj_77c1794b-219c-4908-964a-e615cca6ad41/exporter/0.log"
Jul 15 21:49:00.669478 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:00.669447    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fz8kj_77c1794b-219c-4908-964a-e615cca6ad41/extractor/0.log"
Jul 15 21:49:01.108888 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:01.108860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-l8ws4"
Jul 15 21:49:03.512164 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:03.512135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-8kjnl_bd16b2cd-5a45-4f2c-8472-0745904e6575/manager/0.log"
Jul 15 21:49:03.540162 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:03.540135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-8kjnl_bd16b2cd-5a45-4f2c-8472-0745904e6575/copy-manifests/0.log"
Jul 15 21:49:04.583877 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:04.583805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bcb5978cd-gkqfv_945a6a4b-a3b7-4122-8c5a-4bc8531af02d/kube-auth-proxy/0.log"
Jul 15 21:49:04.718921 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:04.718894    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6547f5d7b6-qlhfc_db887899-543c-44a1-92af-f0b649be473d/router/0.log"
Jul 15 21:49:05.018999 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:05.018959    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6dd8d546cd-98pdm_68ceb8e5-c45b-47c4-91e6-64b1b3754996/manager/0.log"
Jul 15 21:49:05.078265 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:05.078214    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8zjjj_d0f272db-9323-4234-8151-730ebc03a8ec/openshift-lws-operator/0.log"
Jul 15 21:49:06.100995 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:06.100836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bcb5978cd-gkqfv_945a6a4b-a3b7-4122-8c5a-4bc8531af02d/kube-auth-proxy/0.log"
Jul 15 21:49:06.238333 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:06.238304    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6547f5d7b6-qlhfc_db887899-543c-44a1-92af-f0b649be473d/router/0.log"
Jul 15 21:49:10.226106 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:10.226077    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kz9kp_b1a5c7dc-2322-4091-b795-a0dbd54643d0/migrator/0.log"
Jul 15 21:49:10.252666 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:10.252636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-kz9kp_b1a5c7dc-2322-4091-b795-a0dbd54643d0/graceful-termination/0.log"
Jul 15 21:49:10.645159 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:10.645133    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vdbpr_a2f031fb-02a8-4e38-b04f-29da02d06ecb/kube-storage-version-migrator-operator/1.log"
Jul 15 21:49:10.645903 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:10.645878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vdbpr_a2f031fb-02a8-4e38-b04f-29da02d06ecb/kube-storage-version-migrator-operator/0.log"
Jul 15 21:49:11.730192 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.730157    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5tzj2_c72d1eb4-235f-4798-93a8-2a305dd3604f/kube-multus/0.log"
Jul 15 21:49:11.767500 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.767466    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-529zb_4d49da64-81af-4a0e-9068-f30074a5f98e/kube-multus-additional-cni-plugins/0.log"
Jul 15 21:49:11.794142 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.794118    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-529zb_4d49da64-81af-4a0e-9068-f30074a5f98e/egress-router-binary-copy/0.log"
Jul 15 21:49:11.821079 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.821053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-529zb_4d49da64-81af-4a0e-9068-f30074a5f98e/cni-plugins/0.log"
Jul 15 21:49:11.853347 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.853317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-529zb_4d49da64-81af-4a0e-9068-f30074a5f98e/bond-cni-plugin/0.log"
Jul 15 21:49:11.883301 ip-10-0-129-60 kubenswrapper[2581]: I0715 21:49:11.883252    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-529zb_4d49da64-81af-4a0e-9068-f30074a5f98e/routeoverride-cni/0.log"