Jul 21 12:49:14.101355 ip-10-0-130-81 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 12:49:14.101364 ip-10-0-130-81 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 12:49:14.101371 ip-10-0-130-81 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 12:49:14.101585 ip-10-0-130-81 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 12:49:24.128468 ip-10-0-130-81 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 12:49:24.128487 ip-10-0-130-81 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 14bc81d2eb694f5aad4d3430b5cdc8ae --
Jul 21 12:51:18.822412 ip-10-0-130-81 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 12:51:21.074341 ip-10-0-130-81 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:51:21.074341 ip-10-0-130-81 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 12:51:21.074341 ip-10-0-130-81 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:51:21.074341 ip-10-0-130-81 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 12:51:21.074341 ip-10-0-130-81 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:51:21.075057 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.074919    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 12:51:21.082223 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082208    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.082223 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082223    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082227    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082231    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082234    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082237    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082240    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082243    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082246    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082249    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082252    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082255    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082257    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082261    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082263    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082266    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082274    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082276    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082279    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082281    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.082284 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082284    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082287    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082290    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082292    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082297    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082301    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082304    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082307    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082310    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082312    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082315    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082317    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082320    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082322    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082325    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082328    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082330    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082333    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082335    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082337    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.082732 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082340    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082342    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082345    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082347    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082351    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082355    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082358    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082360    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082363    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082366    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082369    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082371    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082374    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082376    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082379    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082382    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082385    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082388    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082390    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.083197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082392    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082395    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082397    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082400    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082402    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082405    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082407    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082409    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082413    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082415    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082418    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082420    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082423    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082425    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082428    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082430    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082433    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082436    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082438    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082441    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.083665 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082443    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082446    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082448    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082451    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082453    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082456    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082460    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082464    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082467    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082470    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082473    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082475    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082478    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082480    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082483    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082485    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082488    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082490    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082493    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.084153 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.082495    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083540    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083549    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083554    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083557    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083560    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083563    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083566    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083569    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083572    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083592    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083596    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083598    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083601    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083603    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083606    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083608    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083611    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083613    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.084604 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083616    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083620    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083623    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083625    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083628    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083630    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083633    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083636    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083638    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083641    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083643    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083646    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083649    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083652    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083655    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083658    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083660    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083662    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083665    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083668    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.085068 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083670    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083673    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083675    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083678    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083681    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083684    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083686    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083689    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083691    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083694    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083696    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083699    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083701    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083705    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083708    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083710    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083713    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083715    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083718    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083721    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.085534 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083723    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083726    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083728    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083731    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083733    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083736    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083738    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083741    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083743    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083746    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083748    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083751    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083753    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083755    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083758    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083760    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083763    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083766    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083769    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083771    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.086029 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083774    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083776    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083778    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083781    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083783    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083786    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083790    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083792    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083795    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083798    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083800    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083803    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083806    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083808    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083812    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083815    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083818    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083821    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083824    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.086500 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083828    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.083832    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084195    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084200    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084203    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084206    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084209    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084212    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084215    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084218    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084221    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084224    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084227    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084229    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084232    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084235    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084237    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084240    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084243    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.086975 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084246    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084248    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084251    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084253    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084255    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084258    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084261    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084263    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084266    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084269    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084271    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084273    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084276    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084280    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084284    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084287    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084290    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084292    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084295    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.087429 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084298    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084300    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084303    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084305    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084308    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084310    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084313    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084316    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084319    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084321    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084324    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084326    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084329    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084331    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084334    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084336    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084338    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084341    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084343    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.087899 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084345    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084348    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084350    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084353    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084356    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084358    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084361    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084364    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084366    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084369    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084372    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084374    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084377    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084379    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084382    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084384    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084387    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084389    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084392    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084397    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.088359 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084400    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084403    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084405    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084408    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084410    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084428    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084432    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084435    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084437    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084440    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084443    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084446    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084449    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084452    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084455    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084458    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084463    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084467    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084471    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.088875 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084475    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084478    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084481    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084484    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.084487    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084563    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084571    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084594    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084599    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084603    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084606    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084610    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084616    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084621    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084624    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084627    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084630    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084633    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084636    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084640    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084643    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084646    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084648    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 12:51:21.089327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084652    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084656    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084659    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084662    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084665    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084668    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084671    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084674    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084678    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084681    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084684    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084687    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084690    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084693    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084697    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084700    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084703    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084706    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084709    2560 flags.go:64] FLAG: --enable-server="true"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084711    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084716    2560 flags.go:64] FLAG: --event-burst="100"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084721    2560 flags.go:64] FLAG: --event-qps="50"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084724    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084728    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 12:51:21.089869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084731    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084735    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084738    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084740    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084743    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084746    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084749    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084752    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084754    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084757    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084760    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084763    2560 flags.go:64] FLAG: --feature-gates=""
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084766    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084769    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084772    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084775    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084778    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084781    2560 flags.go:64] FLAG: --help="false"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084784    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084787    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084789    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084792    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084795    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 12:51:21.090425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084798    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084801    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084804    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084807    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084809    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084812    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084816    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084819    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084822    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084825    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084829    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084831    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084834    2560 flags.go:64] FLAG: --lock-file=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084837    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084840    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084843    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084848    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084851    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084854    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084856    2560 flags.go:64] FLAG: --logging-format="text"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084859    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084862    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084865    2560 flags.go:64] FLAG: --manifest-url=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084868    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084872    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 12:51:21.090996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084877    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084881    2560 flags.go:64] FLAG: --max-pods="110"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084883    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084887    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084890    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084898    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084903    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084906    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084909    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084916    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084919    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084923    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084926    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084931    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084936    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084940    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084942    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084946    2560 flags.go:64] FLAG: --port="10250"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084949    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084952    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0905e345f8f108dbe"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084955    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084958    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084961    2560 flags.go:64] FLAG: --register-node="true"
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084964    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 21 12:51:21.091588 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084967    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084970    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084973    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084976    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084979    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084982    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084985    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084988    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084992    2560 flags.go:64] FLAG: --runonce="false"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084995    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.084998    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085001    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085004    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085006    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085009    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085012    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085015    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085018    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085021    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085024    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085026    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085029    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085033    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085036    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085041    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 12:51:21.092197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085044    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085047    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085051    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085053    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085056    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085059    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085062    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085065    2560 flags.go:64] FLAG: --v="2"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085068    2560 flags.go:64] FLAG: --version="false"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085072    2560 flags.go:64] FLAG: --vmodule=""
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085076    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085079    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085192    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085195    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085198    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085203    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085206    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085208    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085211    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085213    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085216    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085219    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.092794 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085222    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085224    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085226    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085229    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085231    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085234    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085237    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085240    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085243    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085246    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085249    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085251    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085254    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085257    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085260    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085262    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085265    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085267    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085270    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.093321 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085272    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085275    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085278    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085280    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085282    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085285    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085289    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085291    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085294    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085296    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085299    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085302    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085304    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085307    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085309    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085313    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085317    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085320    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085322    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.093799 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085326    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085330    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085332    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085336    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085338    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085341    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085344    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085347    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085350    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085352    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085355    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085357    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085360    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085363    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085367    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085370    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085373    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085376    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085379    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.094255 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085384    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085388    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085391    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085394    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085397    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085399    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085402    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085405    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085407    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085410    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085412    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085415    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085417    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085420    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085423    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085426    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085428    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085431    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085433    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085436    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.094731 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085439    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085441    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085444    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085446    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085449    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085451    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085454    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085456    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085459    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085461    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085464    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.085466    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.085922    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.092735    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.092752    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 12:51:21.095197 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.092765    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.092771    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092831    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092836    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092839    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092842    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092846    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092848    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092851    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092854    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092857    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092859    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092862    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092864    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092867    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092870    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092872    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092875    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092877    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.095551 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092880    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092882    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092885    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092888    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092890    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092903    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092906    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092910    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092912    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092915    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092919    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092922    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092933    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092936    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092939    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092941    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092944    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092946    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092949    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092952    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.096020 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092954    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092957    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092960    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092963    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092965    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092967    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092970    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092972    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092975    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092977    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092980    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092983    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092985    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092987    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092990    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092992    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092995    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.092997    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093000    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093002    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.096498 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093005    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093007    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093011    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093015    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093019    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093029    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093032    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093035    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093037    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093040    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093042    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093045    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093048    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093050    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093052    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093055    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093057    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093060    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093062    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.096988 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093064    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093069    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093072    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093074    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093077    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093079    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093082    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093084    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093088    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093091    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093094    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093097    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093100    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093102    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093105    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093107    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093110    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093113    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.097441 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093121    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093123    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093126    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093128    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.093133    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093294    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093300    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093303    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093305    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093308    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093311    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093313    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093316    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093318    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:51:21.097927 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093321    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093323    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093326    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093329    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093331    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093334    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093337    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093339    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093341    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093344    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093347    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093351    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093354    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093357    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093359    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093362    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093364    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093366    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093369    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093377    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:51:21.098253 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093379    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093382    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093384    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093387    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093389    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093392    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093394    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093397    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093399    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093401    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093404    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093406    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093409    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093411    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093413    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093416    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093418    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093421    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093423    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093425    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:51:21.098845 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093428    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093430    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093433    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093436    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093438    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093440    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093443    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093445    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093447    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093450    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093452    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093456    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093465    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093468    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093470    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093473    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093476    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093479    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093481    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:51:21.099305 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093484    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093486    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093489    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093491    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093494    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093496    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093499    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093501    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093503    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093507    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093510    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093513    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093516    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093518    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093520    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093523    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093525    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093527    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093530    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:51:21.099764 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093532    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093535    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093537    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093540    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093542    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093545    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093547    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093556    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093558    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093561    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093564    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:21.093566    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.093571    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.093711    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.095518    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 12:51:21.100207 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.096656    2560 server.go:1019] "Starting client certificate rotation"
Jul 21 12:51:21.100565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.096765    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 12:51:21.100565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.096807    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 12:51:21.100565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.098935    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 12:51:21.104610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.104587    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 12:51:21.117998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.117981    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 21 12:51:21.119778 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.119766    2560 log.go:25] "Validated CRI v1 image API"
Jul 21 12:51:21.121051 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.121035    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 12:51:21.123180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.123159    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7e09b584-ba22-45c8-9d42-b3c0b1aa4da1:/dev/nvme0n1p4 d8300565-4d9e-4ff2-b939-b82ba3a8d920:/dev/nvme0n1p3]
Jul 21 12:51:21.123235 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.123181    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 12:51:21.128137 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.128035    2560 manager.go:216] Machine: {Timestamp:2026-07-21 12:51:21.126762481 +0000 UTC m=+1.102328314 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100311 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f63e75de433fc1691394f67b9e7a4 SystemUUID:ec2f63e7-5de4-33fc-1691-394f67b9e7a4 BootID:14bc81d2-eb69-4f5a-ad4d-3430b5cdc8ae Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ca:f6:d9:3f:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ca:f6:d9:3f:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c7:28:4c:cb:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 12:51:21.128137 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.128134    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 12:51:21.128277 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.128205    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 12:51:21.128918 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.128902    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 12:51:21.130720 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.130688    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 12:51:21.130856 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.130723    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-81.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 12:51:21.131277 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.131269    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 12:51:21.131307 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.131280    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 12:51:21.131307 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.131287    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 12:51:21.131886 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.131876    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 12:51:21.132827 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.132818    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 12:51:21.136422 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136412    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 12:51:21.136536 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136527    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 12:51:21.136565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136556    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 12:51:21.136565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136565    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 12:51:21.136632 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136592    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 12:51:21.136632 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136605    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 21 12:51:21.136632 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136614    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 12:51:21.136936 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136925    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 12:51:21.136967 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.136942    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 12:51:21.138781 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.138767    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 12:51:21.140390 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.140377    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 12:51:21.140432 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.140407    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 12:51:21.141332 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141321    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 12:51:21.141365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141338    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 12:51:21.141365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141344    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 12:51:21.141365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141350    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 12:51:21.141365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141359    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 12:51:21.141365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141364    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141372    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141378    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141384    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141389    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141397    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141402    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141432    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 12:51:21.141496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.141437    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 12:51:21.144430 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.144417    2560 server.go:1268] "Started kubelet"
Jul 21 12:51:21.144534 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.144508    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 12:51:21.144653 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.144597    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 12:51:21.144729 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.144667    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 12:51:21.145194 ip-10-0-130-81 systemd[1]: Started Kubernetes Kubelet.
Jul 21 12:51:21.148258 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.148232    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 12:51:21.150355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.150311    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-81.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 12:51:21.150433 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.150410    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 12:51:21.150505 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.150438    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 12:51:21.150505 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.150440    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 12:51:21.152710 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.152692    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcbpq"
Jul 21 12:51:21.153573 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.153555    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 12:51:21.154975 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.154196    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-81.ec2.internal.18c44f0fb02cbdbf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-81.ec2.internal,UID:ip-10-0-130-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-81.ec2.internal,},FirstTimestamp:2026-07-21 12:51:21.144384959 +0000 UTC m=+1.119950844,LastTimestamp:2026-07-21 12:51:21.144384959 +0000 UTC m=+1.119950844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-81.ec2.internal,}"
Jul 21 12:51:21.155574 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.155555    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 12:51:21.155688 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.155603    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 12:51:21.155688 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.155675    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.156135 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.156113    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 12:51:21.156308 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.156113    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 12:51:21.156308 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.156288    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 12:51:21.156407 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.156392    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 12:51:21.156407 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.156399    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 12:51:21.157458 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157438    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 12:51:21.157458 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157458    2560 factory.go:55] Registering systemd factory
Jul 21 12:51:21.157568 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157466    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 21 12:51:21.157714 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157691    2560 factory.go:153] Registering CRI-O factory
Jul 21 12:51:21.157714 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157710    2560 factory.go:223] Registration of the crio container factory successfully
Jul 21 12:51:21.157839 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157731    2560 factory.go:103] Registering Raw factory
Jul 21 12:51:21.157839 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.157745    2560 manager.go:1196] Started watching for new ooms in manager
Jul 21 12:51:21.158156 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.158140    2560 manager.go:349] Starting recovery of all containers
Jul 21 12:51:21.161495 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.161467    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 12:51:21.161597 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.161558    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 12:51:21.161936 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.161913    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcbpq"
Jul 21 12:51:21.168274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.168256    2560 manager.go:354] Recovery completed
Jul 21 12:51:21.172722 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.172709    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.178636 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.178622    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.178695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.178649    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.178695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.178663    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.179141 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179126    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 12:51:21.179141 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179139    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 12:51:21.179262 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179147    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.179262 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179153    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 12:51:21.179804 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179787    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.179881 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179813    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.179881 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.179823    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.180956 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.180884    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-81.ec2.internal.18c44f0fb2375c97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-81.ec2.internal,UID:ip-10-0-130-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-81.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-81.ec2.internal,},FirstTimestamp:2026-07-21 12:51:21.178635415 +0000 UTC m=+1.154201248,LastTimestamp:2026-07-21 12:51:21.178635415 +0000 UTC m=+1.154201248,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-81.ec2.internal,}"
Jul 21 12:51:21.181146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.181134    2560 policy_none.go:49] "None policy: Start"
Jul 21 12:51:21.181192 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.181152    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 12:51:21.181192 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.181165    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 12:51:21.183720 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.183705    2560 policy_none.go:47] "Start"
Jul 21 12:51:21.217645 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.217501    2560 manager.go:337] "Starting Device Plugin manager"
Jul 21 12:51:21.217742 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.217668    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 12:51:21.217742 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.217682    2560 server.go:87] "Starting device plugin registration server"
Jul 21 12:51:21.217872 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.217860    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 12:51:21.217921 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.217873    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 12:51:21.217999 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.217987    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 12:51:21.218074 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.218058    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 12:51:21.218074 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.218072    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 12:51:21.218496 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.218479    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 12:51:21.218568 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.218527    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.318610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.318574    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.320671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.319371    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.320671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.319395    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.320671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.319405    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.320671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.319429    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.323237 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.323218    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 12:51:21.324546 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.324496    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 12:51:21.324546 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.324531    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 12:51:21.324688 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.324553    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 12:51:21.324688 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.324597    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 12:51:21.327065 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.327048    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:51:21.327722 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.327702    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.327722 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.327723    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-81.ec2.internal\": node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.384913 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.384886    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.425284 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.425263    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"]
Jul 21 12:51:21.425342 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.425331    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.426836 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.426819    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.426911 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.426843    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.426911 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.426859    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.429096 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429085    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.429258 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.429293 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429273    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.429785 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429770    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.429844 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429793    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.429844 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429809    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.429916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429775    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.429916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429874    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.429916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.429886    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.432027 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.432013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.432098 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.432040    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:51:21.432746 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.432729    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:51:21.432829 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.432760    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:51:21.432829 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.432773    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:51:21.451103 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.451082    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-81.ec2.internal\" not found" node="ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.455312 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.455299    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-81.ec2.internal\" not found" node="ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.468929 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.468910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.468980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.468945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.468980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.468965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4dca545bf09c8bd4721b6d663bce9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"6ed4dca545bf09c8bd4721b6d663bce9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.485027 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.485007    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.569493 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.569610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.569610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4dca545bf09c8bd4721b6d663bce9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"6ed4dca545bf09c8bd4721b6d663bce9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.569610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4dca545bf09c8bd4721b6d663bce9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"6ed4dca545bf09c8bd4721b6d663bce9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.569610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.569610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.569562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdbc7b6f5a185485ad72f02526fa039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"6cdbc7b6f5a185485ad72f02526fa039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.585607 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.585552    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.686348 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.686316    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.754536 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.754512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.757684 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:21.757667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:21.787262 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.787235    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.887733 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.887669    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:21.988204 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:21.988160    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:22.088654 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:22.088618    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jul 21 12:51:22.096796 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.096762    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 12:51:22.096935 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.096917    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 12:51:22.145051 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.144994    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:51:22.155729 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.155710    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 12:51:22.155778 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.155761    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:22.165960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.165945    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 12:51:22.167639 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.167627    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jul 21 12:51:22.167736 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.167716    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 12:46:21 +0000 UTC" deadline="2028-03-13 04:31:23.155437431 +0000 UTC"
Jul 21 12:51:22.167772 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.167737    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14415h40m0.987703033s"
Jul 21 12:51:22.169692 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.169677    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 12:51:22.178328 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.178315    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 12:51:22.196518 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.196499    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jhlx9"
Jul 21 12:51:22.201837 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.201825    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jhlx9"
Jul 21 12:51:22.410788 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.410723    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:51:22.456477 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:22.456446    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdbc7b6f5a185485ad72f02526fa039.slice/crio-9364ddd22b080e58c9495769a84469ed47ffab3f08d0847ae65397a180b9e7d4 WatchSource:0}: Error finding container 9364ddd22b080e58c9495769a84469ed47ffab3f08d0847ae65397a180b9e7d4: Status 404 returned error can't find the container with id 9364ddd22b080e58c9495769a84469ed47ffab3f08d0847ae65397a180b9e7d4
Jul 21 12:51:22.456880 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:22.456861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed4dca545bf09c8bd4721b6d663bce9.slice/crio-46356c05a09bf20e2e82cebbb66d07b126f8a725269240575d24a573264bd19b WatchSource:0}: Error finding container 46356c05a09bf20e2e82cebbb66d07b126f8a725269240575d24a573264bd19b: Status 404 returned error can't find the container with id 46356c05a09bf20e2e82cebbb66d07b126f8a725269240575d24a573264bd19b
Jul 21 12:51:22.461025 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.460999    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 12:51:22.548485 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:22.548459    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:51:23.048920 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.048883    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:51:23.138587 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.138549    2560 apiserver.go:52] "Watching apiserver"
Jul 21 12:51:23.146077 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.146055    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 12:51:23.146487 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.146463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jtd47","kube-system/konnectivity-agent-rl4kn","openshift-dns/node-resolver-ff9mt","openshift-image-registry/node-ca-m5ldv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal","openshift-multus/network-metrics-daemon-7lvxc","openshift-network-diagnostics/network-check-target-md2dx","openshift-network-operator/iptables-alerter-hhbnh","kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6","openshift-cluster-node-tuning-operator/tuned-jdf7k","openshift-multus/multus-additional-cni-plugins-h2bgx","openshift-multus/multus-htb25","openshift-ovn-kubernetes/ovnkube-node-gvd67"]
Jul 21 12:51:23.148922 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.148884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:23.149031 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.148978    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:23.151124 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.151102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.153641 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.153618    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.153734 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.153623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.153950 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.153929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vq8nz\""
Jul 21 12:51:23.154070 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.154053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.156230 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.156210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.156324 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.156265    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkslm\""
Jul 21 12:51:23.156507 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.156489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.156745 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.156727    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.158361 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.158343    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 12:51:23.158658 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.158637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.158790 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.158767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lrcls\""
Jul 21 12:51:23.158869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.158816    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.159009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.158994    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.160902 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.160872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.160994 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.160945    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:23.160994 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.160874    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 12:51:23.161327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161236    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 12:51:23.161327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.161537 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161519    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rdfqg\""
Jul 21 12:51:23.161748 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 12:51:23.161868 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.161960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.161868    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 12:51:23.163238 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.163219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.165504 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.165485    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.165669 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.165642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.165743 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.165668    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gqzh\""
Jul 21 12:51:23.167078 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.167057    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.167755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.168765    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.169085    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.169447    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.169458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.169623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.170105 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.170052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-njxm7\""
Jul 21 12:51:23.171719 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.171637    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 12:51:23.172428 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.172413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.172725 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.172706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 12:51:23.172854 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.172840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mp7dp\""
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.174715    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.174731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.174810    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.174882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.174926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg5np\""
Jul 21 12:51:23.175026 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.174937    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-run\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jf9d\" (UniqueName: \"kubernetes.io/projected/298db261-e45a-42bf-9d24-d73a2e23b6dc-kube-api-access-9jf9d\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-var-lib-kubelet\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-kubelet\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175368 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-ovn\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-netd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-script-lib\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6g8v\" (UniqueName: \"kubernetes.io/projected/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-kube-api-access-g6g8v\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/298db261-e45a-42bf-9d24-d73a2e23b6dc-host\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-kubernetes\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/298db261-e45a-42bf-9d24-d73a2e23b6dc-serviceca\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-systemd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-node-log\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-systemd-units\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-netns\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysconfig\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-systemd\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-host\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqd5\" (UniqueName: \"kubernetes.io/projected/20990eec-f798-477f-9385-306a27bbe21e-kube-api-access-swqd5\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-log-socket\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.175840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-tmp\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-config\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-env-overrides\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-tuned\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-var-lib-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.175964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-etc-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqcwt\" (UniqueName: \"kubernetes.io/projected/39eeb23b-c77c-4dcc-b65c-1054ceb56187-kube-api-access-pqcwt\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20990eec-f798-477f-9385-306a27bbe21e-hosts-file\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20990eec-f798-477f-9385-306a27bbe21e-tmp-dir\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-slash\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-bin\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-sys\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-lib-modules\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.176597 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-modprobe-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.177310 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.176368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-conf\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.177310 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.177000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.179375 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.179354    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 12:51:23.179594 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.179563    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 12:51:23.180104 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.180087    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-45mz8\""
Jul 21 12:51:23.205313 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.205277    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 12:46:22 +0000 UTC" deadline="2028-02-17 19:21:31.770574414 +0000 UTC"
Jul 21 12:51:23.205313 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.205311    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13830h30m8.565266702s"
Jul 21 12:51:23.257260 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.257232    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 12:51:23.276816 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.276779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-os-release\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.276982 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.276823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.276982 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.276861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-systemd-units\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.276982 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.276918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-netns\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.276997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-systemd-units\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysconfig\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-netns\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-systemd\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqd5\" (UniqueName: \"kubernetes.io/projected/20990eec-f798-477f-9385-306a27bbe21e-kube-api-access-swqd5\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysconfig\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t96w\" (UniqueName: \"kubernetes.io/projected/22923338-50f0-4928-b0c3-f3caca503e77-kube-api-access-2t96w\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.277115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-systemd\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-socket-dir-parent\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-multus\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-registration-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-cnibin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-sys-fs\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqcwt\" (UniqueName: \"kubernetes.io/projected/39eeb23b-c77c-4dcc-b65c-1054ceb56187-kube-api-access-pqcwt\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-bin\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277465 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-os-release\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-bin\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjnw\" (UniqueName: \"kubernetes.io/projected/1453e6d8-1f38-494a-8978-4b0b25250592-kube-api-access-ggjnw\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-socket-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-lib-modules\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-run\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-netd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-conf-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-lib-modules\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-run\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277884    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-kubelet\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.277980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.277979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-script-lib\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6g8v\" (UniqueName: \"kubernetes.io/projected/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-kube-api-access-g6g8v\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-bin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-cni-netd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-kubelet\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-multus-certs\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/298db261-e45a-42bf-9d24-d73a2e23b6dc-host\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-cni-binary-copy\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-hostroot\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/298db261-e45a-42bf-9d24-d73a2e23b6dc-host\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/298db261-e45a-42bf-9d24-d73a2e23b6dc-serviceca\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-systemd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-node-log\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-node-log\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-systemd\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22923338-50f0-4928-b0c3-f3caca503e77-host-slash\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-etc-kubernetes\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.278668 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-host\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-log-socket\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-config\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-system-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-device-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-system-cni-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-tmp\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-env-overrides\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-script-lib\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-k8s-cni-cncf-io\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-tuned\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/298db261-e45a-42bf-9d24-d73a2e23b6dc-serviceca\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.278950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-var-lib-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-host\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-log-socket\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.279511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-var-lib-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-etc-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20990eec-f798-477f-9385-306a27bbe21e-hosts-file\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20990eec-f798-477f-9385-306a27bbe21e-tmp-dir\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-slash\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-etc-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj5ws\" (UniqueName: \"kubernetes.io/projected/5d1c007d-7838-4ac2-873c-65be32f856a1-kube-api-access-vj5ws\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsq9w\" (UniqueName: \"kubernetes.io/projected/d239105b-e86f-440c-a5e0-4dcc4a1acc39-kube-api-access-gsq9w\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-env-overrides\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20990eec-f798-477f-9385-306a27bbe21e-hosts-file\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-sys\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-modprobe-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-conf\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20990eec-f798-477f-9385-306a27bbe21e-tmp-dir\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-sys\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovnkube-config\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jf9d\" (UniqueName: \"kubernetes.io/projected/298db261-e45a-42bf-9d24-d73a2e23b6dc-kube-api-access-9jf9d\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-sysctl-conf\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-modprobe-d\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-netns\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-host-slash\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.279981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/312e9065-5985-422b-ae14-79239a357c71-agent-certs\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-var-lib-kubelet\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-ovn\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-var-lib-kubelet\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-ovn\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/312e9065-5985-422b-ae14-79239a357c71-konnectivity-ca\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.280957 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-kubelet-config\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-dbus\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22923338-50f0-4928-b0c3-f3caca503e77-iptables-alerter-script\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-kubelet\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-run-openvswitch\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-multus-daemon-config\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7xg\" (UniqueName: \"kubernetes.io/projected/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kube-api-access-cr7xg\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-kubernetes\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-cnibin\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.281599 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.280602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-kubernetes\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.281933 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.281670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.281933 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.281817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-etc-tuned\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.282474 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.282454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39eeb23b-c77c-4dcc-b65c-1054ceb56187-tmp\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.287348 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.286620    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:23.287348 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.286645    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:23.287348 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.286666    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:23.287348 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.286756    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:23.786736481 +0000 UTC m=+3.762302316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:23.289025 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.288991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqcwt\" (UniqueName: \"kubernetes.io/projected/39eeb23b-c77c-4dcc-b65c-1054ceb56187-kube-api-access-pqcwt\") pod \"tuned-jdf7k\" (UID: \"39eeb23b-c77c-4dcc-b65c-1054ceb56187\") " pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.289264 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.289244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqd5\" (UniqueName: \"kubernetes.io/projected/20990eec-f798-477f-9385-306a27bbe21e-kube-api-access-swqd5\") pod \"node-resolver-ff9mt\" (UID: \"20990eec-f798-477f-9385-306a27bbe21e\") " pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.290223 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.289872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jf9d\" (UniqueName: \"kubernetes.io/projected/298db261-e45a-42bf-9d24-d73a2e23b6dc-kube-api-access-9jf9d\") pod \"node-ca-m5ldv\" (UID: \"298db261-e45a-42bf-9d24-d73a2e23b6dc\") " pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.291032 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.290984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6g8v\" (UniqueName: \"kubernetes.io/projected/b568ba73-cca8-4e02-83f1-dcc040a5c2d9-kube-api-access-g6g8v\") pod \"ovnkube-node-gvd67\" (UID: \"b568ba73-cca8-4e02-83f1-dcc040a5c2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.329680 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.329570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"6cdbc7b6f5a185485ad72f02526fa039","Type":"ContainerStarted","Data":"9364ddd22b080e58c9495769a84469ed47ffab3f08d0847ae65397a180b9e7d4"}
Jul 21 12:51:23.330818 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.330792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" event={"ID":"6ed4dca545bf09c8bd4721b6d663bce9","Type":"ContainerStarted","Data":"46356c05a09bf20e2e82cebbb66d07b126f8a725269240575d24a573264bd19b"}
Jul 21 12:51:23.381230 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-system-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.381386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-system-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.381386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-device-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.381386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-system-cni-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.381508 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-k8s-cni-cncf-io\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.381508 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj5ws\" (UniqueName: \"kubernetes.io/projected/5d1c007d-7838-4ac2-873c-65be32f856a1-kube-api-access-vj5ws\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.381508 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsq9w\" (UniqueName: \"kubernetes.io/projected/d239105b-e86f-440c-a5e0-4dcc4a1acc39-kube-api-access-gsq9w\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.381508 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-netns\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/312e9065-5985-422b-ae14-79239a357c71-agent-certs\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/312e9065-5985-422b-ae14-79239a357c71-konnectivity-ca\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-kubelet-config\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-dbus\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.381706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22923338-50f0-4928-b0c3-f3caca503e77-iptables-alerter-script\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-kubelet\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-multus-daemon-config\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7xg\" (UniqueName: \"kubernetes.io/projected/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kube-api-access-cr7xg\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-cnibin\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-os-release\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t96w\" (UniqueName: \"kubernetes.io/projected/22923338-50f0-4928-b0c3-f3caca503e77-kube-api-access-2t96w\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-socket-dir-parent\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-multus\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.381992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-registration-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.382009 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-cnibin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-sys-fs\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-os-release\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjnw\" (UniqueName: \"kubernetes.io/projected/1453e6d8-1f38-494a-8978-4b0b25250592-kube-api-access-ggjnw\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-socket-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-conf-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-bin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-multus-certs\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-cni-binary-copy\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-hostroot\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22923338-50f0-4928-b0c3-f3caca503e77-host-slash\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-etc-kubernetes\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.382550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-device-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-system-cni-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.382703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-k8s-cni-cncf-io\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.383171    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:23.383353 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.383234    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:23.883215105 +0000 UTC m=+3.858780931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:23.383666 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.383387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-netns\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.384333 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/312e9065-5985-422b-ae14-79239a357c71-konnectivity-ca\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.384460 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.384460 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-sys-fs\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.384460 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-kubelet-config\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.384460 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-os-release\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.384460 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f7c55e6-847f-440a-a059-661b9d2037ef-dbus\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.384715 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-os-release\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.384715 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.384605    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:23.384715 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.384653    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:23.884637502 +0000 UTC m=+3.860203328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:23.384715 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-socket-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.384922 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-conf-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.384922 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.385020 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.385020 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22923338-50f0-4928-b0c3-f3caca503e77-iptables-alerter-script\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.385020 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-cni-dir\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385159 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-kubelet\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385159 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-bin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385159 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-run-multus-certs\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-hostroot\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22923338-50f0-4928-b0c3-f3caca503e77-host-slash\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-etc-kubernetes\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d1c007d-7838-4ac2-873c-65be32f856a1-cnibin\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-registration-dir\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-multus-daemon-config\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-multus-socket-dir-parent\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-host-var-lib-cni-multus\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.384310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1453e6d8-1f38-494a-8978-4b0b25250592-cnibin\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.385769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.386380 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d1c007d-7838-4ac2-873c-65be32f856a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.386380 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.385981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1453e6d8-1f38-494a-8978-4b0b25250592-cni-binary-copy\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.387754 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.387715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/312e9065-5985-422b-ae14-79239a357c71-agent-certs\") pod \"konnectivity-agent-rl4kn\" (UID: \"312e9065-5985-422b-ae14-79239a357c71\") " pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.393956 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.393902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7xg\" (UniqueName: \"kubernetes.io/projected/c2e14639-6f3a-439e-a4f6-fa64cb3a32c1-kube-api-access-cr7xg\") pod \"aws-ebs-csi-driver-node-9tjj6\" (UID: \"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.394468 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.394416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj5ws\" (UniqueName: \"kubernetes.io/projected/5d1c007d-7838-4ac2-873c-65be32f856a1-kube-api-access-vj5ws\") pod \"multus-additional-cni-plugins-h2bgx\" (UID: \"5d1c007d-7838-4ac2-873c-65be32f856a1\") " pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.395053 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.394551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t96w\" (UniqueName: \"kubernetes.io/projected/22923338-50f0-4928-b0c3-f3caca503e77-kube-api-access-2t96w\") pod \"iptables-alerter-hhbnh\" (UID: \"22923338-50f0-4928-b0c3-f3caca503e77\") " pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.395053 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.395014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjnw\" (UniqueName: \"kubernetes.io/projected/1453e6d8-1f38-494a-8978-4b0b25250592-kube-api-access-ggjnw\") pod \"multus-htb25\" (UID: \"1453e6d8-1f38-494a-8978-4b0b25250592\") " pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.395231 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.395186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsq9w\" (UniqueName: \"kubernetes.io/projected/d239105b-e86f-440c-a5e0-4dcc4a1acc39-kube-api-access-gsq9w\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.462617 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.462565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jdf7k"
Jul 21 12:51:23.469913 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.469889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff9mt"
Jul 21 12:51:23.480483 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.480457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m5ldv"
Jul 21 12:51:23.485355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.485332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:23.491244 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.491220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhbnh"
Jul 21 12:51:23.498786 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.498763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-htb25"
Jul 21 12:51:23.505479 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.505459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:23.511548 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.511407    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6"
Jul 21 12:51:23.517286 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.517266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2bgx"
Jul 21 12:51:23.885644 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.885611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:23.885845 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.885669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:23.885845 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:23.885714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:23.885845 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885793    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885848    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885866    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885874    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:24.885850177 +0000 UTC m=+4.861416001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885800    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:24.885909095 +0000 UTC m=+4.861474917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885875    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:23.886006 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:23.885957    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:24.885950739 +0000 UTC m=+4.861516559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:24.205674 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:24.205618    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 12:46:22 +0000 UTC" deadline="2027-12-29 05:56:42.270519607 +0000 UTC"
Jul 21 12:51:24.205674 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:24.205670    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12617h5m18.064856182s"
Jul 21 12:51:24.442972 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.442905    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1453e6d8_1f38_494a_8978_4b0b25250592.slice/crio-e78e7b7f5f572f3323ef119bf8391ba1608b25f601d0dd6697b9346f7e21b4bc WatchSource:0}: Error finding container e78e7b7f5f572f3323ef119bf8391ba1608b25f601d0dd6697b9346f7e21b4bc: Status 404 returned error can't find the container with id e78e7b7f5f572f3323ef119bf8391ba1608b25f601d0dd6697b9346f7e21b4bc
Jul 21 12:51:24.445992 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.445899    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e14639_6f3a_439e_a4f6_fa64cb3a32c1.slice/crio-fcbbee46836d05c973ac9645f8c1f777b18f043e44b5f00b6e28027b97f8f22b WatchSource:0}: Error finding container fcbbee46836d05c973ac9645f8c1f777b18f043e44b5f00b6e28027b97f8f22b: Status 404 returned error can't find the container with id fcbbee46836d05c973ac9645f8c1f777b18f043e44b5f00b6e28027b97f8f22b
Jul 21 12:51:24.450817 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.450793    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1c007d_7838_4ac2_873c_65be32f856a1.slice/crio-363eaeda8ca9b061697ddd7f3e9d08679afa57df52d1db9927cfcb31afd23d66 WatchSource:0}: Error finding container 363eaeda8ca9b061697ddd7f3e9d08679afa57df52d1db9927cfcb31afd23d66: Status 404 returned error can't find the container with id 363eaeda8ca9b061697ddd7f3e9d08679afa57df52d1db9927cfcb31afd23d66
Jul 21 12:51:24.451536 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.451492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20990eec_f798_477f_9385_306a27bbe21e.slice/crio-6b9c09150c8baa048126ec8e715ae9083832b175e804da51ac2b0d027ea3454d WatchSource:0}: Error finding container 6b9c09150c8baa048126ec8e715ae9083832b175e804da51ac2b0d027ea3454d: Status 404 returned error can't find the container with id 6b9c09150c8baa048126ec8e715ae9083832b175e804da51ac2b0d027ea3454d
Jul 21 12:51:24.452848 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.452783    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb568ba73_cca8_4e02_83f1_dcc040a5c2d9.slice/crio-c1d102a9f0179a158827d7dd3f0c5895b0fdfc8e8b79bf8982d51d8375f4e651 WatchSource:0}: Error finding container c1d102a9f0179a158827d7dd3f0c5895b0fdfc8e8b79bf8982d51d8375f4e651: Status 404 returned error can't find the container with id c1d102a9f0179a158827d7dd3f0c5895b0fdfc8e8b79bf8982d51d8375f4e651
Jul 21 12:51:24.454136 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.454117    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298db261_e45a_42bf_9d24_d73a2e23b6dc.slice/crio-c0aa2724175157dc53f9636a81238a2b7589de4540948fd58730dd9b5ad13aac WatchSource:0}: Error finding container c0aa2724175157dc53f9636a81238a2b7589de4540948fd58730dd9b5ad13aac: Status 404 returned error can't find the container with id c0aa2724175157dc53f9636a81238a2b7589de4540948fd58730dd9b5ad13aac
Jul 21 12:51:24.455308 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.455286    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312e9065_5985_422b_ae14_79239a357c71.slice/crio-eac966cd91e1a33dee335d9e6598e6b66e50ec5a980b506996556510d2f5fc83 WatchSource:0}: Error finding container eac966cd91e1a33dee335d9e6598e6b66e50ec5a980b506996556510d2f5fc83: Status 404 returned error can't find the container with id eac966cd91e1a33dee335d9e6598e6b66e50ec5a980b506996556510d2f5fc83
Jul 21 12:51:24.456615 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.456565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39eeb23b_c77c_4dcc_b65c_1054ceb56187.slice/crio-325b313596cec8f37e5d51bf7fbe5d0d2fba563eb23d184124c4d1db093ba0d8 WatchSource:0}: Error finding container 325b313596cec8f37e5d51bf7fbe5d0d2fba563eb23d184124c4d1db093ba0d8: Status 404 returned error can't find the container with id 325b313596cec8f37e5d51bf7fbe5d0d2fba563eb23d184124c4d1db093ba0d8
Jul 21 12:51:24.457484 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:51:24.457182    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22923338_50f0_4928_b0c3_f3caca503e77.slice/crio-a2a71e05153bee4201c75500155f44bcffcd72cbb5e7ea7602e1173a92029b30 WatchSource:0}: Error finding container a2a71e05153bee4201c75500155f44bcffcd72cbb5e7ea7602e1173a92029b30: Status 404 returned error can't find the container with id a2a71e05153bee4201c75500155f44bcffcd72cbb5e7ea7602e1173a92029b30
Jul 21 12:51:24.893571 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:24.893253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:24.893571 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:24.893554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:24.893571 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893442    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893617    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:24.893618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893634    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893698    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:26.893680247 +0000 UTC m=+6.869246086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893734    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893744    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893786    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:26.893770937 +0000 UTC m=+6.869336775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:24.893869 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:24.893804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:26.893794641 +0000 UTC m=+6.869360466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:25.325805 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.325700    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:25.326403 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:25.325844    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:25.326403 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.325891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:25.326403 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.325891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:25.326403 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:25.326004    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:25.326403 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:25.326064    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:25.337739 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.337696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" event={"ID":"6ed4dca545bf09c8bd4721b6d663bce9","Type":"ContainerStarted","Data":"e6ef4d9de9d9f260f0d408e722f5050feb5e6c7751e09bf319a290fb9d32dce8"}
Jul 21 12:51:25.347278 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.347246    2560 generic.go:356] "Generic (PLEG): container finished" podID="6cdbc7b6f5a185485ad72f02526fa039" containerID="625dbb11b91efcfbe810c8c2516531a0bd0d081c32127f233f7e06563d030cfb" exitCode=0
Jul 21 12:51:25.347425 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.347324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"6cdbc7b6f5a185485ad72f02526fa039","Type":"ContainerDied","Data":"625dbb11b91efcfbe810c8c2516531a0bd0d081c32127f233f7e06563d030cfb"}
Jul 21 12:51:25.353429 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.353403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jdf7k" event={"ID":"39eeb23b-c77c-4dcc-b65c-1054ceb56187","Type":"ContainerStarted","Data":"325b313596cec8f37e5d51bf7fbe5d0d2fba563eb23d184124c4d1db093ba0d8"}
Jul 21 12:51:25.353555 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.353446    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" podStartSLOduration=3.353428474 podStartE2EDuration="3.353428474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:25.353003776 +0000 UTC m=+5.328569619" watchObservedRunningTime="2026-07-21 12:51:25.353428474 +0000 UTC m=+5.328994521"
Jul 21 12:51:25.359482 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.359456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhbnh" event={"ID":"22923338-50f0-4928-b0c3-f3caca503e77","Type":"ContainerStarted","Data":"a2a71e05153bee4201c75500155f44bcffcd72cbb5e7ea7602e1173a92029b30"}
Jul 21 12:51:25.369902 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.369309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"c1d102a9f0179a158827d7dd3f0c5895b0fdfc8e8b79bf8982d51d8375f4e651"}
Jul 21 12:51:25.382223 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.382191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m5ldv" event={"ID":"298db261-e45a-42bf-9d24-d73a2e23b6dc","Type":"ContainerStarted","Data":"c0aa2724175157dc53f9636a81238a2b7589de4540948fd58730dd9b5ad13aac"}
Jul 21 12:51:25.405489 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.405430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff9mt" event={"ID":"20990eec-f798-477f-9385-306a27bbe21e","Type":"ContainerStarted","Data":"6b9c09150c8baa048126ec8e715ae9083832b175e804da51ac2b0d027ea3454d"}
Jul 21 12:51:25.418244 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.417784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerStarted","Data":"363eaeda8ca9b061697ddd7f3e9d08679afa57df52d1db9927cfcb31afd23d66"}
Jul 21 12:51:25.432075 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.432037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rl4kn" event={"ID":"312e9065-5985-422b-ae14-79239a357c71","Type":"ContainerStarted","Data":"eac966cd91e1a33dee335d9e6598e6b66e50ec5a980b506996556510d2f5fc83"}
Jul 21 12:51:25.446031 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.445996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6" event={"ID":"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1","Type":"ContainerStarted","Data":"fcbbee46836d05c973ac9645f8c1f777b18f043e44b5f00b6e28027b97f8f22b"}
Jul 21 12:51:25.457099 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:25.456770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-htb25" event={"ID":"1453e6d8-1f38-494a-8978-4b0b25250592","Type":"ContainerStarted","Data":"e78e7b7f5f572f3323ef119bf8391ba1608b25f601d0dd6697b9346f7e21b4bc"}
Jul 21 12:51:26.475964 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:26.475927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"6cdbc7b6f5a185485ad72f02526fa039","Type":"ContainerStarted","Data":"7d2fc5a9d84ae0876be0162808b39f25490cff85b06eaee051e55f569380fea5"}
Jul 21 12:51:26.910919 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:26.910768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:26.910919 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:26.910905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:26.911143 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:26.910956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:26.911143 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911123    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:26.911245 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911147    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:26.911245 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911162    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:26.911245 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:30.911202931 +0000 UTC m=+10.886768770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:26.911894 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911632    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:26.911894 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911683    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:30.9116689 +0000 UTC m=+10.887234726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:26.911894 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911737    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:26.911894 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:26.911771    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:30.911757493 +0000 UTC m=+10.887323318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:27.325644 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:27.324903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:27.325644 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:27.325056    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:27.325644 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:27.325447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:27.325644 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:27.325536    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:27.326278 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:27.326045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:27.326278 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:27.326148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:29.325160 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:29.325067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:29.325642 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:29.325067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:29.325642 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:29.325173    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:29.325642 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:29.325223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:29.325642 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:29.325312    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:29.325642 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:29.325422    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:30.945885 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:30.945841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:30.945909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:30.945948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946069    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946131    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:38.946109131 +0000 UTC m=+18.921674954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946167    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946184    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946196    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946237    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:38.946223222 +0000 UTC m=+18.921789055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946291    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:30.946365 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:30.946321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:38.946310818 +0000 UTC m=+18.921876642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:31.326083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:31.326193    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:31.326272    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:31.326398    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:31.326416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:31.326600 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:31.326541    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:33.325176 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:33.325147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:33.325640 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:33.325145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:33.325640 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:33.325266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:33.325640 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:33.325265    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:33.325640 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:33.325358    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:33.325640 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:33.325437    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:35.325472 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:35.325438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:35.325472 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:35.325447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:35.325938 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:35.325447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:35.325938 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:35.325554    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:35.325938 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:35.325650    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:35.325938 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:35.325741    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:37.325059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:37.325018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:37.325506 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:37.325018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:37.325506 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:37.325131    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:37.325506 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:37.325019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:37.325506 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:37.325205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:37.325506 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:37.325296    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:39.012883 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.012846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.012899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.012932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013033    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013085    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:51:55.01306552 +0000 UTC m=+34.988631340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013098    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013149    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:55.013136246 +0000 UTC m=+34.988702070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013099    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013173    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013186    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:39.013352 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.013215    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:51:55.013208614 +0000 UTC m=+34.988774437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:39.324942 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.324852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:39.325103 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.324854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:39.325103 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.324988    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:39.325103 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:39.325023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:39.325244 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.325131    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:39.325244 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:39.325206    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:41.325760 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:41.325726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:41.326290 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:41.325804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:41.326290 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:41.325824    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:41.326290 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:41.325919    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:41.326290 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:41.325950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:41.326290 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:41.326025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:43.325353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.325072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:43.326136 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.325071    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:43.326136 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:43.325428    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:43.326136 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.325125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:43.326136 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:43.325495    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:43.326136 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:43.325560    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:43.506875 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.506848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jdf7k" event={"ID":"39eeb23b-c77c-4dcc-b65c-1054ceb56187","Type":"ContainerStarted","Data":"bc2229afa03e1ea564737f7ad59780a24bc357a42170212f15dc4bf58616ea29"}
Jul 21 12:51:43.509232 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.509210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"aa26a15ca7accbe8a5732175e21e815c37329e0487e43fd2e4da7d305881b174"}
Jul 21 12:51:43.509328 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.509279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"3fdd529ff8883ec084fd725cffa605731fe7782be58ea73ab76d76b8541089c3"}
Jul 21 12:51:43.509328 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.509318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"86054b93a6cbaa9e7cf212c6c84af781420fb07cdd7d6ed32ad7795682220f04"}
Jul 21 12:51:43.509395 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.509354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"47331220b986740534fbf173b4d2296c75c716a629ec0e16aeac485bf9ffb728"}
Jul 21 12:51:43.509395 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.509384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"3b76f6997d8850345a78a6ffa6028ec79d6259b555169a92d4fb6346f3a6f72f"}
Jul 21 12:51:43.510559 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.510536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m5ldv" event={"ID":"298db261-e45a-42bf-9d24-d73a2e23b6dc","Type":"ContainerStarted","Data":"ad1e4bad472001862b0869bc11641c4e8ae30da78d5b792c8d2985d25c2196c7"}
Jul 21 12:51:43.511895 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.511874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff9mt" event={"ID":"20990eec-f798-477f-9385-306a27bbe21e","Type":"ContainerStarted","Data":"e80c13889698c6b0b950c4a1143f076354ec111ceeabcbd8dbb0c74f7fb0ba68"}
Jul 21 12:51:43.513330 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.513308    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="69f851898e2ab5afac34d39a97d1ae0dce3119e9aeb9ccb9ba97d680244cf2db" exitCode=0
Jul 21 12:51:43.513405 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.513379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"69f851898e2ab5afac34d39a97d1ae0dce3119e9aeb9ccb9ba97d680244cf2db"}
Jul 21 12:51:43.514774 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.514670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rl4kn" event={"ID":"312e9065-5985-422b-ae14-79239a357c71","Type":"ContainerStarted","Data":"3d1e5e66752ea67e7b015891e4d9f889b6e30f2eaf34ef03bee15dca8fc50ea1"}
Jul 21 12:51:43.516113 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.516091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6" event={"ID":"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1","Type":"ContainerStarted","Data":"da4d203c47fe30f308a68382e11282df3c1157f8c522b792b2acddc0b7fc32c9"}
Jul 21 12:51:43.517358 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.517340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-htb25" event={"ID":"1453e6d8-1f38-494a-8978-4b0b25250592","Type":"ContainerStarted","Data":"489e76014df89dd8cac2670d6c97687042c50038cb91b4f203fc81bb6777d125"}
Jul 21 12:51:43.526466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.526430    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" podStartSLOduration=21.526420107 podStartE2EDuration="21.526420107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:26.492224948 +0000 UTC m=+6.467790791" watchObservedRunningTime="2026-07-21 12:51:43.526420107 +0000 UTC m=+23.501985949"
Jul 21 12:51:43.526679 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.526660    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jdf7k" podStartSLOduration=4.073205337 podStartE2EDuration="22.526655694s" totalImagesPullingTime="18.453450357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:43.52570192 +0000 UTC m=+23.501267764" watchObservedRunningTime="2026-07-21 12:51:43.526655694 +0000 UTC m=+23.502221536"
Jul 21 12:51:43.565333 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.565301    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ff9mt" podStartSLOduration=4.108353115 podStartE2EDuration="22.565290227s" totalImagesPullingTime="18.456937112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:43.564856146 +0000 UTC m=+23.540421991" watchObservedRunningTime="2026-07-21 12:51:43.565290227 +0000 UTC m=+23.540856069"
Jul 21 12:51:43.579424 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.579378    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m5ldv" podStartSLOduration=4.125377364 podStartE2EDuration="22.57936032s" totalImagesPullingTime="18.453982956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:43.57881906 +0000 UTC m=+23.554384922" watchObservedRunningTime="2026-07-21 12:51:43.57936032 +0000 UTC m=+23.554926163"
Jul 21 12:51:43.593461 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.593429    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rl4kn" podStartSLOduration=8.038604312 podStartE2EDuration="22.593421127s" totalImagesPullingTime="14.554816815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:43.592748014 +0000 UTC m=+23.568313857" watchObservedRunningTime="2026-07-21 12:51:43.593421127 +0000 UTC m=+23.568986969"
Jul 21 12:51:43.614693 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:43.614652    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-htb25" podStartSLOduration=4.088657932 podStartE2EDuration="22.614634125s" totalImagesPullingTime="18.525976193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:43.61370828 +0000 UTC m=+23.589274143" watchObservedRunningTime="2026-07-21 12:51:43.614634125 +0000 UTC m=+23.590199970"
Jul 21 12:51:44.046135 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.046103    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:44.046675 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.046655    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:44.411943 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.411904    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 12:51:44.521138 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.521106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhbnh" event={"ID":"22923338-50f0-4928-b0c3-f3caca503e77","Type":"ContainerStarted","Data":"6fa31b7a5172bcce480f2694955fff55b3bbe173114fc095abaafc9ac132060c"}
Jul 21 12:51:44.526480 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.526451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"b1b3a84aac390e90ee4b0723c89412bd8a6db8f56183824b8879c779c0ca2e42"}
Jul 21 12:51:44.528667 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.528642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6" event={"ID":"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1","Type":"ContainerStarted","Data":"a94f7308c04333c2f7c85c5c6ea464590d66bad185462ebb2451305f27f1a0ce"}
Jul 21 12:51:44.538424 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:44.538383    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hhbnh" podStartSLOduration=5.089961121 podStartE2EDuration="23.538369988s" totalImagesPullingTime="18.448408867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:44.537837484 +0000 UTC m=+24.513403320" watchObservedRunningTime="2026-07-21 12:51:44.538369988 +0000 UTC m=+24.513935830"
Jul 21 12:51:45.231032 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.230907    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T12:51:44.411939202Z","UUID":"4c31e892-dec0-4f9e-8382-28091caec57f","Handler":null,"Name":"","Endpoint":""}
Jul 21 12:51:45.232569 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.232539    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 12:51:45.232714 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.232601    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 12:51:45.325017 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.324946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:45.325017 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.324962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:45.325017 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.324984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:45.325280 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:45.325075    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:45.325280 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:45.325183    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:45.325280 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:45.325274    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:45.531377 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:45.531304    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 12:51:46.537621 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:46.537389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"43e48fb42866ecb92fbcacb25da11a982bdd6c958c1c005319e575c21049965b"}
Jul 21 12:51:46.539695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:46.539668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6" event={"ID":"c2e14639-6f3a-439e-a4f6-fa64cb3a32c1","Type":"ContainerStarted","Data":"d183fda0bbc1953255998cddbf4bae5d89d5ffc2f557f1aa68f63ab1660a1d71"}
Jul 21 12:51:46.559775 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:46.559727    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9tjj6" podStartSLOduration=4.532312316 podStartE2EDuration="25.559709728s" totalImagesPullingTime="21.027397412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:46.5596813 +0000 UTC m=+26.535247143" watchObservedRunningTime="2026-07-21 12:51:46.559709728 +0000 UTC m=+26.535275565"
Jul 21 12:51:47.325113 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:47.325074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:47.325332 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:47.325080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:47.325332 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:47.325205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:47.325332 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:47.325214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:47.325332 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:47.325302    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:47.325534 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:47.325388    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:48.547565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.547280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" event={"ID":"b568ba73-cca8-4e02-83f1-dcc040a5c2d9","Type":"ContainerStarted","Data":"e7db4e52a930845daf4d2393917bb8d7abfcaea60a78aaf401c16a34f96ce129"}
Jul 21 12:51:48.547565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.547550    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:48.548338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.547621    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:48.548338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.547663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:48.549876 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.549851    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="5082b5e028aabe53b0292f107437e5da8c0e4197e3800670cf4a6a98506d6b60" exitCode=0
Jul 21 12:51:48.549994 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.549902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"5082b5e028aabe53b0292f107437e5da8c0e4197e3800670cf4a6a98506d6b60"}
Jul 21 12:51:48.563160 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.563134    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:48.563324 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.563309    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:51:48.579337 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:48.579293    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67" podStartSLOduration=9.058233762 podStartE2EDuration="27.579278541s" totalImagesPullingTime="18.521044779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:48.578984206 +0000 UTC m=+28.554550067" watchObservedRunningTime="2026-07-21 12:51:48.579278541 +0000 UTC m=+28.554844417"
Jul 21 12:51:49.324921 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:49.324884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:49.324921 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:49.324926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:49.325209 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:49.324884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:49.325209 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:49.324997    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:49.325209 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:49.325052    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:49.325209 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:49.325156    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:50.152758 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:50.152737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:50.153093 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:50.152840    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 12:51:50.153339 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:50.153314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rl4kn"
Jul 21 12:51:50.556652 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:50.556614    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="7c4f70cf284d9c96d139bb9154629af09132dcb28de3b68d6ab7fa824b88d1c1" exitCode=0
Jul 21 12:51:50.556814 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:50.556663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"7c4f70cf284d9c96d139bb9154629af09132dcb28de3b68d6ab7fa824b88d1c1"}
Jul 21 12:51:51.326284 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:51.326241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:51.326712 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:51.326319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:51.326712 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:51.326331    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:51.326712 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:51.326439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:51.326712 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:51.326476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:51.326712 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:51.326627    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:52.562929 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:52.562898    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="60e54cbf67a7b130c9e8f27ac5e1f9c33295e258dad9588bc60518fbdc08825c" exitCode=0
Jul 21 12:51:52.563295 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:52.562942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"60e54cbf67a7b130c9e8f27ac5e1f9c33295e258dad9588bc60518fbdc08825c"}
Jul 21 12:51:53.325255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:53.325225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:53.325430 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:53.325233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:53.325430 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:53.325341    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:53.325430 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:53.325233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:53.325559 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:53.325461    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:53.325559 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:53.325550    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:55.031630 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.031596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:55.031630 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.031641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.031680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031750    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031788    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031802    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031811    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret podName:8f7c55e6-847f-440a-a059-661b9d2037ef nodeName:}" failed. No retries permitted until 2026-07-21 12:52:27.031793623 +0000 UTC m=+67.007359447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret") pod "global-pull-secret-syncer-jtd47" (UID: "8f7c55e6-847f-440a-a059-661b9d2037ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031814    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dwvr7 for pod openshift-network-diagnostics/network-check-target-md2dx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031841    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7 podName:ae3cc534-0d3c-4683-a118-d08b0f1d785d nodeName:}" failed. No retries permitted until 2026-07-21 12:52:27.031839055 +0000 UTC m=+67.007404889 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwvr7" (UniqueName: "kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7") pod "network-check-target-md2dx" (UID: "ae3cc534-0d3c-4683-a118-d08b0f1d785d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:55.032064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.031920    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs podName:d239105b-e86f-440c-a5e0-4dcc4a1acc39 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:27.031902314 +0000 UTC m=+67.007468140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs") pod "network-metrics-daemon-7lvxc" (UID: "d239105b-e86f-440c-a5e0-4dcc4a1acc39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:55.325029 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.324954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:55.325029 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.324990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:55.325194 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:55.324955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:55.325194 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.325092    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:55.325194 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.325167    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:55.325305 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:55.325265    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:57.325326 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:57.325291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:57.325709 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:57.325409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:57.325709 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:57.325419    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:57.325709 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:57.325505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:57.325709 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:57.325505    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:57.325709 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:57.325602    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:57.577224 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:57.577142    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="3cb5b5f653911e2599d7de74ae84654b7f0a8b4ff4b107132865c0d57adb971f" exitCode=0
Jul 21 12:51:57.577224 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:57.577195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"3cb5b5f653911e2599d7de74ae84654b7f0a8b4ff4b107132865c0d57adb971f"}
Jul 21 12:51:58.581986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:58.581821    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d1c007d-7838-4ac2-873c-65be32f856a1" containerID="48d87ba5307c1bfa008621d942318d3ac5c7a9375a903acdd5024236c2297b2e" exitCode=0
Jul 21 12:51:58.581986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:58.581897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerDied","Data":"48d87ba5307c1bfa008621d942318d3ac5c7a9375a903acdd5024236c2297b2e"}
Jul 21 12:51:59.325480 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:59.325449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:51:59.325480 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:59.325467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:51:59.325742 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:59.325466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:51:59.325742 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:59.325565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:51:59.325742 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:59.325624    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:51:59.325742 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:51:59.325696    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:51:59.587318 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:59.587238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" event={"ID":"5d1c007d-7838-4ac2-873c-65be32f856a1","Type":"ContainerStarted","Data":"7ee50ee6829f44602339f4bdad246403841bae66da2d688400aa31f38e222191"}
Jul 21 12:51:59.613917 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:51:59.613864    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h2bgx" podStartSLOduration=8.790138266 podStartE2EDuration="38.613847924s" totalImagesPullingTime="29.823709658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:59.612480119 +0000 UTC m=+39.588045961" watchObservedRunningTime="2026-07-21 12:51:59.613847924 +0000 UTC m=+39.589413771"
Jul 21 12:52:01.325917 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:01.325889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:01.326292 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:01.325974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:01.326292 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:01.326058    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:01.326292 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:01.326146    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:01.326292 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:01.326176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:01.326292 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:01.326263    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:03.325384 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:03.325349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:03.325749 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:03.325394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:03.325749 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:03.325468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:03.325749 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:03.325523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:03.325749 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:03.325623    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:03.325749 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:03.325698    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:05.325209 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:05.325179    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:05.325613 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:05.325189    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:05.325613 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:05.325268    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:05.325613 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:05.325352    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:05.325613 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:05.325386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:05.325613 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:05.325434    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:07.326726 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:07.326680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:07.327270 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:07.326829    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:07.327348 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:07.327284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:07.327348 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:07.327316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:07.327462 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:07.327435    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:07.327559 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:07.327522    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:08.326296 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.326268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lvxc"]
Jul 21 12:52:08.326434 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.326362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:08.326474 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:08.326444    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:08.330950 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.330879    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtd47"]
Jul 21 12:52:08.331761 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.330964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:08.331761 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:08.331051    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:08.331761 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.331730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-md2dx"]
Jul 21 12:52:08.331924 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:08.331808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:08.331924 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:08.331890    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:10.325784 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:10.325602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:10.326155 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:10.325625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:10.326155 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:10.325850    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:10.326155 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:10.325653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:10.326155 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:10.325930    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:10.326155 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:10.326015    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:12.325594 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.325543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:12.325959 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.325543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:12.325959 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:12.325655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtd47" podUID="8f7c55e6-847f-440a-a059-661b9d2037ef"
Jul 21 12:52:12.325959 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.325668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:12.325959 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:12.325767    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lvxc" podUID="d239105b-e86f-440c-a5e0-4dcc4a1acc39"
Jul 21 12:52:12.325959 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:12.325825    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-md2dx" podUID="ae3cc534-0d3c-4683-a118-d08b0f1d785d"
Jul 21 12:52:12.856550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.856521    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeReady"
Jul 21 12:52:12.856739 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.856656    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 12:52:12.907250 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.907221    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvwng"]
Jul 21 12:52:12.928154 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.928133    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-crxg7"]
Jul 21 12:52:12.928282 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.928243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:12.930960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.930940    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 12:52:12.930960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.930955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 12:52:12.931125 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.930956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kg652\""
Jul 21 12:52:12.931125 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.931043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 12:52:12.952150 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.952127    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvwng"]
Jul 21 12:52:12.952150 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.952155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crxg7"]
Jul 21 12:52:12.952285 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.952236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:12.954692 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.954668    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 12:52:12.954692 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.954670    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 12:52:12.954874 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.954812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kcsl4\""
Jul 21 12:52:12.970987 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.970965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr8f8\" (UniqueName: \"kubernetes.io/projected/016c740f-06d3-47f0-bdd7-2dd7dab09c74-kube-api-access-zr8f8\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:12.971083 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:12.971004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/016c740f-06d3-47f0-bdd7-2dd7dab09c74-cert\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.071819 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/566e349e-4089-44d5-ab3c-aa5a61c21a65-metrics-tls\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.071819 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/566e349e-4089-44d5-ab3c-aa5a61c21a65-tmp-dir\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.071998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr8f8\" (UniqueName: \"kubernetes.io/projected/016c740f-06d3-47f0-bdd7-2dd7dab09c74-kube-api-access-zr8f8\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.071998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/566e349e-4089-44d5-ab3c-aa5a61c21a65-config-volume\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.071998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/016c740f-06d3-47f0-bdd7-2dd7dab09c74-cert\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.071998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.071954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2rm\" (UniqueName: \"kubernetes.io/projected/566e349e-4089-44d5-ab3c-aa5a61c21a65-kube-api-access-mf2rm\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.076030 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.076006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/016c740f-06d3-47f0-bdd7-2dd7dab09c74-cert\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.079810 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.079793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr8f8\" (UniqueName: \"kubernetes.io/projected/016c740f-06d3-47f0-bdd7-2dd7dab09c74-kube-api-access-zr8f8\") pod \"ingress-canary-fvwng\" (UID: \"016c740f-06d3-47f0-bdd7-2dd7dab09c74\") " pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.173224 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/566e349e-4089-44d5-ab3c-aa5a61c21a65-config-volume\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.173346 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2rm\" (UniqueName: \"kubernetes.io/projected/566e349e-4089-44d5-ab3c-aa5a61c21a65-kube-api-access-mf2rm\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.173346 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/566e349e-4089-44d5-ab3c-aa5a61c21a65-metrics-tls\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.173450 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/566e349e-4089-44d5-ab3c-aa5a61c21a65-tmp-dir\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.173639 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/566e349e-4089-44d5-ab3c-aa5a61c21a65-tmp-dir\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.173749 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.173733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/566e349e-4089-44d5-ab3c-aa5a61c21a65-config-volume\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.175665 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.175648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/566e349e-4089-44d5-ab3c-aa5a61c21a65-metrics-tls\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.181528 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.181510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2rm\" (UniqueName: \"kubernetes.io/projected/566e349e-4089-44d5-ab3c-aa5a61c21a65-kube-api-access-mf2rm\") pod \"dns-default-crxg7\" (UID: \"566e349e-4089-44d5-ab3c-aa5a61c21a65\") " pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.237586 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.237556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvwng"
Jul 21 12:52:13.260032 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.260011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:13.470840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.470745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvwng"]
Jul 21 12:52:13.475617 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.473768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crxg7"]
Jul 21 12:52:13.479270 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:13.479249    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566e349e_4089_44d5_ab3c_aa5a61c21a65.slice/crio-fe1568cc9db5fa79cd06ca460d8f617494a223d6ab4862ec60172cbbc17540e2 WatchSource:0}: Error finding container fe1568cc9db5fa79cd06ca460d8f617494a223d6ab4862ec60172cbbc17540e2: Status 404 returned error can't find the container with id fe1568cc9db5fa79cd06ca460d8f617494a223d6ab4862ec60172cbbc17540e2
Jul 21 12:52:13.616057 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.616026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvwng" event={"ID":"016c740f-06d3-47f0-bdd7-2dd7dab09c74","Type":"ContainerStarted","Data":"db82173a7f129276fcd9d7ab5aea9c3cf66c0100b5cc69ab246b5b55cfcc3fcc"}
Jul 21 12:52:13.617007 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.616980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crxg7" event={"ID":"566e349e-4089-44d5-ab3c-aa5a61c21a65","Type":"ContainerStarted","Data":"fe1568cc9db5fa79cd06ca460d8f617494a223d6ab4862ec60172cbbc17540e2"}
Jul 21 12:52:13.799989 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.799922    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"]
Jul 21 12:52:13.831645 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.831622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"]
Jul 21 12:52:13.831765 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.831707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:13.834050 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.834025    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 12:52:13.834175 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.834068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rljzx\""
Jul 21 12:52:13.879710 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.879682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8crnr\" (UID: \"5392a2c4-8acb-4f1c-928f-a1e2a80d3696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:13.980930 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:13.980898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8crnr\" (UID: \"5392a2c4-8acb-4f1c-928f-a1e2a80d3696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:13.981050 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:13.981027    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 12:52:13.981107 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:13.981095    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates podName:5392a2c4-8acb-4f1c-928f-a1e2a80d3696 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:14.481075196 +0000 UTC m=+54.456641028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-8crnr" (UID: "5392a2c4-8acb-4f1c-928f-a1e2a80d3696") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 12:52:14.129567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.129315    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-46rhv"]
Jul 21 12:52:14.154695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.154388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-46rhv"]
Jul 21 12:52:14.154695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.154516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.157299 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.157273    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzpc5\""
Jul 21 12:52:14.157708 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.157687    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 12:52:14.157807 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.157717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 12:52:14.158089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.157955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 12:52:14.158089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.158010    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 12:52:14.283865 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.283833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-data-volume\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.284031 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.283909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-crio-socket\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.284031 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.283947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.284148 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.284045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn652\" (UniqueName: \"kubernetes.io/projected/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-api-access-xn652\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.284148 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.284104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.325100 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.325055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:14.325100 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.325096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:14.325329 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.325056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:14.328335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.327655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 12:52:14.328335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.327900    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtsf5\""
Jul 21 12:52:14.328335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.328021    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 12:52:14.328335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.328088    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 12:52:14.328335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.328252    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ccp9\""
Jul 21 12:52:14.328790 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.328769    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 12:52:14.384738 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.384686    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-crio-socket\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.384738 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.384726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.384917 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.384879    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.384977 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.384939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-crio-socket\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.384977 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.384953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn652\" (UniqueName: \"kubernetes.io/projected/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-api-access-xn652\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.385066 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.385035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.385120 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.385069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-data-volume\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.385171 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.385123    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:14.885102942 +0000 UTC m=+54.860668769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.385232 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.385213    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.385282 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.385264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:14.885251819 +0000 UTC m=+54.860817640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.385613 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.385573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-data-volume\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.395335 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.395294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn652\" (UniqueName: \"kubernetes.io/projected/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-api-access-xn652\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.485846 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.485806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8crnr\" (UID: \"5392a2c4-8acb-4f1c-928f-a1e2a80d3696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:14.488789 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.488763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5392a2c4-8acb-4f1c-928f-a1e2a80d3696-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8crnr\" (UID: \"5392a2c4-8acb-4f1c-928f-a1e2a80d3696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:14.740428 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.740393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:14.875139 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.875111    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"]
Jul 21 12:52:14.888776 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.888750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.888878 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:14.888838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:14.888878 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.888852    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.889002 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.888912    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:15.88889652 +0000 UTC m=+55.864462340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.889002 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.888991    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.889104 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:14.889046    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:15.889029195 +0000 UTC m=+55.864595018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:15.305117 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:15.305083    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5392a2c4_8acb_4f1c_928f_a1e2a80d3696.slice/crio-d25ca773c58a35367a38c2c7e3a0ef7d7933c860f5d148e30e340901e6a8c281 WatchSource:0}: Error finding container d25ca773c58a35367a38c2c7e3a0ef7d7933c860f5d148e30e340901e6a8c281: Status 404 returned error can't find the container with id d25ca773c58a35367a38c2c7e3a0ef7d7933c860f5d148e30e340901e6a8c281
Jul 21 12:52:15.627570 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:15.627470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr" event={"ID":"5392a2c4-8acb-4f1c-928f-a1e2a80d3696","Type":"ContainerStarted","Data":"d25ca773c58a35367a38c2c7e3a0ef7d7933c860f5d148e30e340901e6a8c281"}
Jul 21 12:52:15.897817 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:15.897774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:15.897998 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:15.897890    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:15.897998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:15.897962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:15.897998 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:15.897972    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:17.897955314 +0000 UTC m=+57.873521134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:15.898177 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:15.898125    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:15.898226 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:15.898179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:17.898165749 +0000 UTC m=+57.873731569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:16.013348 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:16.013318    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff9mt_20990eec-f798-477f-9385-306a27bbe21e/dns-node-resolver/0.log"
Jul 21 12:52:16.634655 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:16.634570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crxg7" event={"ID":"566e349e-4089-44d5-ab3c-aa5a61c21a65","Type":"ContainerStarted","Data":"d486b7094319d486c1f0f20d5f6ed962bbeb34fad3dd857902e6a8596309c1c0"}
Jul 21 12:52:16.636642 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:16.636557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvwng" event={"ID":"016c740f-06d3-47f0-bdd7-2dd7dab09c74","Type":"ContainerStarted","Data":"0bebd225b967d9e21d065342f9738d54641c9f51ec171a1bd4d93b368cab4344"}
Jul 21 12:52:16.655112 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:16.655061    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvwng" podStartSLOduration=1.687368996 podStartE2EDuration="4.655040729s" totalImagesPullingTime="2.967671733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:16.654043085 +0000 UTC m=+56.629608931" watchObservedRunningTime="2026-07-21 12:52:16.655040729 +0000 UTC m=+56.630606572"
Jul 21 12:52:17.212938 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.212913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m5ldv_298db261-e45a-42bf-9d24-d73a2e23b6dc/node-ca/0.log"
Jul 21 12:52:17.641181 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.641144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crxg7" event={"ID":"566e349e-4089-44d5-ab3c-aa5a61c21a65","Type":"ContainerStarted","Data":"a6c4d9255f176f2b942345a29bfbff9637d8013ccab7e223ac17e17f87f9f07b"}
Jul 21 12:52:17.641546 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.641218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:17.642613 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.642566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr" event={"ID":"5392a2c4-8acb-4f1c-928f-a1e2a80d3696","Type":"ContainerStarted","Data":"04080b5665b1f8fb6768d19c0ad259cd1279cc9e71fdc3f45e846a69afaae241"}
Jul 21 12:52:17.642746 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.642705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:17.647427 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.647406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr"
Jul 21 12:52:17.660928 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.660889    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-crxg7" podStartSLOduration=2.7026341780000003 podStartE2EDuration="5.66087526s" totalImagesPullingTime="2.958241082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:17.66013057 +0000 UTC m=+57.635696412" watchObservedRunningTime="2026-07-21 12:52:17.66087526 +0000 UTC m=+57.636441102"
Jul 21 12:52:17.675345 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.675296    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8crnr" podStartSLOduration=2.537654838 podStartE2EDuration="4.675284398s" totalImagesPullingTime="2.13762956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:17.674179688 +0000 UTC m=+57.649745534" watchObservedRunningTime="2026-07-21 12:52:17.675284398 +0000 UTC m=+57.650850239"
Jul 21 12:52:17.889293 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.889264    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"]
Jul 21 12:52:17.900204 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.900182    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:17.903349 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.903289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 12:52:17.904232 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904206    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"]
Jul 21 12:52:17.904461 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904429    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 12:52:17.904461 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904438    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 12:52:17.904698 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904525    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jvbgg\""
Jul 21 12:52:17.904698 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 12:52:17.904818 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.904785    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 12:52:17.913715 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.913696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:17.913798 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:17.913744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:17.913845 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:17.913802    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:17.913845 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:17.913820    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:17.913915 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:17.913848    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:21.913834103 +0000 UTC m=+61.889399923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:17.913915 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:17.913887    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:21.913880867 +0000 UTC m=+61.889446686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:18.013783 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.013724    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvwng_016c740f-06d3-47f0-bdd7-2dd7dab09c74/serve-healthcheck-canary/0.log"
Jul 21 12:52:18.014755 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.014730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6467\" (UniqueName: \"kubernetes.io/projected/ddd39b07-167e-4921-bebc-230b43636741-kube-api-access-j6467\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.014840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.014762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.014840 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.014825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.014916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.014867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddd39b07-167e-4921-bebc-230b43636741-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.115294 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.115268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.115378 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.115318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddd39b07-167e-4921-bebc-230b43636741-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.115428 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.115373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6467\" (UniqueName: \"kubernetes.io/projected/ddd39b07-167e-4921-bebc-230b43636741-kube-api-access-j6467\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.115428 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.115394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.115495 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:18.115483    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 12:52:18.115539 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:18.115535    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls podName:ddd39b07-167e-4921-bebc-230b43636741 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:18.615521944 +0000 UTC m=+58.591087763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-qtmz7" (UID: "ddd39b07-167e-4921-bebc-230b43636741") : secret "prometheus-operator-tls" not found
Jul 21 12:52:18.117986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.117958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.120515 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.120494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddd39b07-167e-4921-bebc-230b43636741-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.126728 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.126709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6467\" (UniqueName: \"kubernetes.io/projected/ddd39b07-167e-4921-bebc-230b43636741-kube-api-access-j6467\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.406458 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.406430    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:52:18.421659 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.421628    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:52:18.421808 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.421715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.425109 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 12:52:18.425237 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 12:52:18.425237 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425228    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 12:52:18.425346 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425297    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 12:52:18.425346 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 12:52:18.425602 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.425564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 12:52:18.426503 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.426484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 12:52:18.426632 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.426485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9l4m2\""
Jul 21 12:52:18.431154 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.431136    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 12:52:18.518263 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518381 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518381 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518381 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6pg\" (UniqueName: \"kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518481 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518481 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.518481 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.518444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.619505 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.619637 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:18.619637 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.619637 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.619637 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.619843 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:18.619713    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 12:52:18.619843 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:18.619774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls podName:ddd39b07-167e-4921-bebc-230b43636741 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:19.619756294 +0000 UTC m=+59.595322128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-qtmz7" (UID: "ddd39b07-167e-4921-bebc-230b43636741") : secret "prometheus-operator-tls" not found
Jul 21 12:52:18.619843 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6pg\" (UniqueName: \"kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620005 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620005 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.619910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620319 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.620293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620422 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.620377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620500 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.620481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.620684 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.620665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.622085 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.622066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.622175 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.622158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.628166 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.628144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6pg\" (UniqueName: \"kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg\") pod \"console-67d7cd5679-tczpc\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") " pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.740255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.740195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:18.909000 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:18.908970    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:52:18.911769 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:18.911746    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee9cdd7_0324_4fe4_bc8c_a211b8788b5a.slice/crio-253b4785b96d77e9aaef7f925442e98e5adcb2f187433b171217b9498c131d31 WatchSource:0}: Error finding container 253b4785b96d77e9aaef7f925442e98e5adcb2f187433b171217b9498c131d31: Status 404 returned error can't find the container with id 253b4785b96d77e9aaef7f925442e98e5adcb2f187433b171217b9498c131d31
Jul 21 12:52:19.628616 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:19.628574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:19.630752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:19.630732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd39b07-167e-4921-bebc-230b43636741-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qtmz7\" (UID: \"ddd39b07-167e-4921-bebc-230b43636741\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:19.648327 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:19.648294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7cd5679-tczpc" event={"ID":"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a","Type":"ContainerStarted","Data":"253b4785b96d77e9aaef7f925442e98e5adcb2f187433b171217b9498c131d31"}
Jul 21 12:52:19.709759 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:19.709728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"
Jul 21 12:52:19.845028 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:19.844992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7"]
Jul 21 12:52:19.848806 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:19.848777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd39b07_167e_4921_bebc_230b43636741.slice/crio-cc27f11e86b17e151ec66a55b94bc39204db6fb42bf0a13df1cc62a37f0978ef WatchSource:0}: Error finding container cc27f11e86b17e151ec66a55b94bc39204db6fb42bf0a13df1cc62a37f0978ef: Status 404 returned error can't find the container with id cc27f11e86b17e151ec66a55b94bc39204db6fb42bf0a13df1cc62a37f0978ef
Jul 21 12:52:20.570074 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:20.570046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvd67"
Jul 21 12:52:20.652815 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:20.652778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7" event={"ID":"ddd39b07-167e-4921-bebc-230b43636741","Type":"ContainerStarted","Data":"cc27f11e86b17e151ec66a55b94bc39204db6fb42bf0a13df1cc62a37f0978ef"}
Jul 21 12:52:21.949190 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:21.949133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:21.949641 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:21.949290    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:21.949641 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:21.949323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:21.949641 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:21.949378    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:29.949355933 +0000 UTC m=+69.924921768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:21.949641 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:21.949421    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:21.949641 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:21.949477    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm podName:ddbf40d8-570d-4a80-a478-c3f3ceb951dc nodeName:}" failed. No retries permitted until 2026-07-21 12:52:29.949460361 +0000 UTC m=+69.925026189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46rhv" (UID: "ddbf40d8-570d-4a80-a478-c3f3ceb951dc") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:22.660728 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:22.660686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7cd5679-tczpc" event={"ID":"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a","Type":"ContainerStarted","Data":"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"}
Jul 21 12:52:22.662348 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:22.662324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7" event={"ID":"ddd39b07-167e-4921-bebc-230b43636741","Type":"ContainerStarted","Data":"c69868eb9a37fb18b1b609ab3f8b663096eca30f29d2e6c26e0a03f01424fdc0"}
Jul 21 12:52:22.662448 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:22.662362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7" event={"ID":"ddd39b07-167e-4921-bebc-230b43636741","Type":"ContainerStarted","Data":"d7f295bd30e00c97342a31735af07dc6f6cabbfa07dd4e70ef501a51911f69ff"}
Jul 21 12:52:22.683757 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:22.682940    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67d7cd5679-tczpc" podStartSLOduration=1.584574514 podStartE2EDuration="4.68292075s" totalImagesPullingTime="3.098346236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:22.681717961 +0000 UTC m=+62.657283796" watchObservedRunningTime="2026-07-21 12:52:22.68292075 +0000 UTC m=+62.658486593"
Jul 21 12:52:22.700229 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:22.700183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qtmz7" podStartSLOduration=3.542031796 podStartE2EDuration="5.700168071s" totalImagesPullingTime="2.158136275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:22.699912535 +0000 UTC m=+62.675478367" watchObservedRunningTime="2026-07-21 12:52:22.700168071 +0000 UTC m=+62.675733914"
Jul 21 12:52:24.263091 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.263052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"]
Jul 21 12:52:24.265357 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.265333    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xcsmc"]
Jul 21 12:52:24.265474 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.265456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.267113 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.267096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.268659 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.268636    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wtksc\""
Jul 21 12:52:24.268753 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.268663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 12:52:24.268753 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.268664    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 12:52:24.269725 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.269702    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 12:52:24.269812 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.269741    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjmwx\""
Jul 21 12:52:24.270092 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.270072    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 12:52:24.270196 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.270114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 12:52:24.275209 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.275188    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"]
Jul 21 12:52:24.277010 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.276993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.279598 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.279565    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 12:52:24.279772 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.279755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 12:52:24.280097 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.280081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 12:52:24.280159 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.280096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-79lkj\""
Jul 21 12:52:24.281972 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.281955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"]
Jul 21 12:52:24.294085 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.294067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"]
Jul 21 12:52:24.368169 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.368273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdwj\" (UniqueName: \"kubernetes.io/projected/057222e5-6d89-41b2-9e8f-e09f11416815-kube-api-access-qxdwj\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.368273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-sys\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4rw2\" (UniqueName: \"kubernetes.io/projected/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-api-access-b4rw2\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057222e5-6d89-41b2-9e8f-e09f11416815-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-textfile\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368529 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-wtmp\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-metrics-client-ca\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ld4v\" (UniqueName: \"kubernetes.io/projected/561024e5-b532-4812-aa86-741c66f217b2-kube-api-access-7ld4v\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.368811 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.368752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-root\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdwj\" (UniqueName: \"kubernetes.io/projected/057222e5-6d89-41b2-9e8f-e09f11416815-kube-api-access-qxdwj\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-sys\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469416 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4rw2\" (UniqueName: \"kubernetes.io/projected/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-api-access-b4rw2\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:24.469433    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-sys\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057222e5-6d89-41b2-9e8f-e09f11416815-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:24.469649    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls podName:561024e5-b532-4812-aa86-741c66f217b2 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:24.969610144 +0000 UTC m=+64.945175964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls") pod "node-exporter-xcsmc" (UID: "561024e5-b532-4812-aa86-741c66f217b2") : secret "node-exporter-tls" not found
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.469779 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-textfile\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470075 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-wtmp\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470075 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.469952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-wtmp\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470185 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470185 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-textfile\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470288 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.470288 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.470387 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-metrics-client-ca\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470387 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057222e5-6d89-41b2-9e8f-e09f11416815-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.470387 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ld4v\" (UniqueName: \"kubernetes.io/projected/561024e5-b532-4812-aa86-741c66f217b2-kube-api-access-7ld4v\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470387 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.470600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.470600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-root\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.470759 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:24.470684    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 12:52:24.470806 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:52:24.470749    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls podName:057222e5-6d89-41b2-9e8f-e09f11416815 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:24.970717373 +0000 UTC m=+64.946283207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-m4r4r" (UID: "057222e5-6d89-41b2-9e8f-e09f11416815") : secret "openshift-state-metrics-tls" not found
Jul 21 12:52:24.470865 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/561024e5-b532-4812-aa86-741c66f217b2-metrics-client-ca\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470865 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/561024e5-b532-4812-aa86-741c66f217b2-root\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.470865 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.470821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.471501 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.471476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.472253 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.472233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.472371 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.472307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.472520 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.472499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.472763 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.472747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.480940 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.480915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdwj\" (UniqueName: \"kubernetes.io/projected/057222e5-6d89-41b2-9e8f-e09f11416815-kube-api-access-qxdwj\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.481180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.481163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4rw2\" (UniqueName: \"kubernetes.io/projected/7cff7821-dfe6-49fe-b9a9-9de825ec6a9e-kube-api-access-b4rw2\") pod \"kube-state-metrics-56c5594674-tkgl6\" (UID: \"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.481780 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.481763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ld4v\" (UniqueName: \"kubernetes.io/projected/561024e5-b532-4812-aa86-741c66f217b2-kube-api-access-7ld4v\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.587920 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.587862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"
Jul 21 12:52:24.706622 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.706594    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-tkgl6"]
Jul 21 12:52:24.709837 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:24.709813    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cff7821_dfe6_49fe_b9a9_9de825ec6a9e.slice/crio-75c44f4c6a251ca8efc485096cbb80281f54afd6eef10c7016b25199b56d83ad WatchSource:0}: Error finding container 75c44f4c6a251ca8efc485096cbb80281f54afd6eef10c7016b25199b56d83ad: Status 404 returned error can't find the container with id 75c44f4c6a251ca8efc485096cbb80281f54afd6eef10c7016b25199b56d83ad
Jul 21 12:52:24.974512 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.974479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:24.974671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.974528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.976776 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.976756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/561024e5-b532-4812-aa86-741c66f217b2-node-exporter-tls\") pod \"node-exporter-xcsmc\" (UID: \"561024e5-b532-4812-aa86-741c66f217b2\") " pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:24.976923 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:24.976907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057222e5-6d89-41b2-9e8f-e09f11416815-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-m4r4r\" (UID: \"057222e5-6d89-41b2-9e8f-e09f11416815\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:25.175247 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.175214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"
Jul 21 12:52:25.180123 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.180097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcsmc"
Jul 21 12:52:25.190677 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:25.190642    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561024e5_b532_4812_aa86_741c66f217b2.slice/crio-62c184e2c222681e9267beb7e595507dfd589ef93711641d7e334d91ea7909fd WatchSource:0}: Error finding container 62c184e2c222681e9267beb7e595507dfd589ef93711641d7e334d91ea7909fd: Status 404 returned error can't find the container with id 62c184e2c222681e9267beb7e595507dfd589ef93711641d7e334d91ea7909fd
Jul 21 12:52:25.304920 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.304891    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r"]
Jul 21 12:52:25.308128 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:25.308104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057222e5_6d89_41b2_9e8f_e09f11416815.slice/crio-d3e3b4311384d4cd1ea0ac05253f6397823ea1ef0b7649c5bab67f9847d3d0c9 WatchSource:0}: Error finding container d3e3b4311384d4cd1ea0ac05253f6397823ea1ef0b7649c5bab67f9847d3d0c9: Status 404 returned error can't find the container with id d3e3b4311384d4cd1ea0ac05253f6397823ea1ef0b7649c5bab67f9847d3d0c9
Jul 21 12:52:25.381054 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.381023    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 12:52:25.385237 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.385191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.389049 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.388151    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 12:52:25.389049 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.388661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 12:52:25.389187 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.389050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 12:52:25.389750 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.389733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 12:52:25.389947 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.389933    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 12:52:25.390144 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.390130    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-snbgh\""
Jul 21 12:52:25.390558 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.390408    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 12:52:25.390694 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.390558    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 12:52:25.390694 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.390625    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 12:52:25.391177 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.391150    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 12:52:25.400334 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.400252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 12:52:25.478738 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-config-volume\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478738 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbjp\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-kube-api-access-pfbjp\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478932 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478932 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478932 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478932 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.478932 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-web-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.478980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-config-out\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.479006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.479033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.479054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.479180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.479082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579807 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-config-volume\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579807 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbjp\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-kube-api-access-pfbjp\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.579986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.579983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-web-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-config-out\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580146 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580388 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580388 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.580499 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.581950 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.580939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.581950 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.581881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe924a8-5055-42d2-9203-d8aac1881595-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.583242 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.583223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-web-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.583378 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.583350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.583605 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.583562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe924a8-5055-42d2-9203-d8aac1881595-config-out\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.583753 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.583732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.583894 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.583874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-config-volume\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.584133 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.584111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.584190 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.584146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.584274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.584256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe924a8-5055-42d2-9203-d8aac1881595-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.584834 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.584802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.595892 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.595871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbjp\" (UniqueName: \"kubernetes.io/projected/abe924a8-5055-42d2-9203-d8aac1881595-kube-api-access-pfbjp\") pod \"alertmanager-main-0\" (UID: \"abe924a8-5055-42d2-9203-d8aac1881595\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.674195 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.674158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcsmc" event={"ID":"561024e5-b532-4812-aa86-741c66f217b2","Type":"ContainerStarted","Data":"62c184e2c222681e9267beb7e595507dfd589ef93711641d7e334d91ea7909fd"}
Jul 21 12:52:25.676321 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.676288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r" event={"ID":"057222e5-6d89-41b2-9e8f-e09f11416815","Type":"ContainerStarted","Data":"054d68dfaa0f3e09bbb1cab79c961ae9362682ffe96ef419eabe9d67f4a16448"}
Jul 21 12:52:25.676447 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.676361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r" event={"ID":"057222e5-6d89-41b2-9e8f-e09f11416815","Type":"ContainerStarted","Data":"486e88a02dcc2b6523eb1551a6d76f002e1163ad02dcf3d1d741f29b7240bf42"}
Jul 21 12:52:25.676447 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.676390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r" event={"ID":"057222e5-6d89-41b2-9e8f-e09f11416815","Type":"ContainerStarted","Data":"d3e3b4311384d4cd1ea0ac05253f6397823ea1ef0b7649c5bab67f9847d3d0c9"}
Jul 21 12:52:25.677542 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.677507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6" event={"ID":"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e","Type":"ContainerStarted","Data":"75c44f4c6a251ca8efc485096cbb80281f54afd6eef10c7016b25199b56d83ad"}
Jul 21 12:52:25.711965 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.711942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 12:52:25.877740 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:25.877707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 12:52:26.607527 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:26.607489    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe924a8_5055_42d2_9203_d8aac1881595.slice/crio-febdac0adf9a7b99fcd0b072d17061d37129d3e23339ae0180c772863d1c128e WatchSource:0}: Error finding container febdac0adf9a7b99fcd0b072d17061d37129d3e23339ae0180c772863d1c128e: Status 404 returned error can't find the container with id febdac0adf9a7b99fcd0b072d17061d37129d3e23339ae0180c772863d1c128e
Jul 21 12:52:26.682402 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:26.682362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"febdac0adf9a7b99fcd0b072d17061d37129d3e23339ae0180c772863d1c128e"}
Jul 21 12:52:27.092541 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.092498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:27.092721 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.092559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:27.092721 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.092636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:27.098794 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.098765    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 12:52:27.098915 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.098803    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 12:52:27.099824 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.099800    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 12:52:27.105999 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.105980    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 12:52:27.106395 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.106366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f7c55e6-847f-440a-a059-661b9d2037ef-original-pull-secret\") pod \"global-pull-secret-syncer-jtd47\" (UID: \"8f7c55e6-847f-440a-a059-661b9d2037ef\") " pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:27.106470 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.106392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d239105b-e86f-440c-a5e0-4dcc4a1acc39-metrics-certs\") pod \"network-metrics-daemon-7lvxc\" (UID: \"d239105b-e86f-440c-a5e0-4dcc4a1acc39\") " pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:27.116082 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.116058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvr7\" (UniqueName: \"kubernetes.io/projected/ae3cc534-0d3c-4683-a118-d08b0f1d785d-kube-api-access-dwvr7\") pod \"network-check-target-md2dx\" (UID: \"ae3cc534-0d3c-4683-a118-d08b0f1d785d\") " pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:27.241019 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.240941    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtsf5\""
Jul 21 12:52:27.247797 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.247772    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtd47"
Jul 21 12:52:27.248837 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.248803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lvxc"
Jul 21 12:52:27.258254 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.258229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ccp9\""
Jul 21 12:52:27.264707 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.264680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:27.279726 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.279683    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78954f84b9-tddfl"]
Jul 21 12:52:27.285144 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.285121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.288078 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.288052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 12:52:27.288338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.288316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 12:52:27.288592 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.288563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 12:52:27.288834 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.288801    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3r8tvi2h6ramh\""
Jul 21 12:52:27.289224 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.289205    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 12:52:27.289796 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.289777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 12:52:27.290060 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.290028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fgvkh\""
Jul 21 12:52:27.296894 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.296670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78954f84b9-tddfl"]
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf82a627-8ff4-4c65-adbe-e2f248d29624-metrics-client-ca\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lx76\" (UniqueName: \"kubernetes.io/projected/bf82a627-8ff4-4c65-adbe-e2f248d29624-kube-api-access-7lx76\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-grpc-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.395089 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.394947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.412756 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.412685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lvxc"]
Jul 21 12:52:27.416186 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:27.416146    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd239105b_e86f_440c_a5e0_4dcc4a1acc39.slice/crio-b81d6612e82563ede75e1071ff6e7d61d43bc76164da344d81f91850457c39fe WatchSource:0}: Error finding container b81d6612e82563ede75e1071ff6e7d61d43bc76164da344d81f91850457c39fe: Status 404 returned error can't find the container with id b81d6612e82563ede75e1071ff6e7d61d43bc76164da344d81f91850457c39fe
Jul 21 12:52:27.432293 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.432265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtd47"]
Jul 21 12:52:27.435330 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:27.435305    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7c55e6_847f_440a_a059_661b9d2037ef.slice/crio-1767ddd619c1c1e7f3e2b8340bd494c002bc205de1e4c34e261c5464ec481e50 WatchSource:0}: Error finding container 1767ddd619c1c1e7f3e2b8340bd494c002bc205de1e4c34e261c5464ec481e50: Status 404 returned error can't find the container with id 1767ddd619c1c1e7f3e2b8340bd494c002bc205de1e4c34e261c5464ec481e50
Jul 21 12:52:27.453059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.453038    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-md2dx"]
Jul 21 12:52:27.455409 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:27.455387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3cc534_0d3c_4683_a118_d08b0f1d785d.slice/crio-94977523db23079f987ffc96d454226fd052a239d815d85b38daf385ab60f382 WatchSource:0}: Error finding container 94977523db23079f987ffc96d454226fd052a239d815d85b38daf385ab60f382: Status 404 returned error can't find the container with id 94977523db23079f987ffc96d454226fd052a239d815d85b38daf385ab60f382
Jul 21 12:52:27.495997 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.495946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.495997 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.495976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496103 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.495999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-grpc-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496155 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.496132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496220 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.496208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496270 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.496255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf82a627-8ff4-4c65-adbe-e2f248d29624-metrics-client-ca\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496343 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.496323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lx76\" (UniqueName: \"kubernetes.io/projected/bf82a627-8ff4-4c65-adbe-e2f248d29624-kube-api-access-7lx76\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.496409 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.496381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.497085 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.497053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf82a627-8ff4-4c65-adbe-e2f248d29624-metrics-client-ca\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.498687 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.498640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.498774 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.498759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-grpc-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.498960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.498932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.499029 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.499006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.499091 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.499050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.499364 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.499347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf82a627-8ff4-4c65-adbe-e2f248d29624-secret-thanos-querier-tls\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.505464 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.505443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lx76\" (UniqueName: \"kubernetes.io/projected/bf82a627-8ff4-4c65-adbe-e2f248d29624-kube-api-access-7lx76\") pod \"thanos-querier-78954f84b9-tddfl\" (UID: \"bf82a627-8ff4-4c65-adbe-e2f248d29624\") " pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.602676 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.602641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:27.647706 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.647680    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-crxg7"
Jul 21 12:52:27.691651 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.691547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtd47" event={"ID":"8f7c55e6-847f-440a-a059-661b9d2037ef","Type":"ContainerStarted","Data":"1767ddd619c1c1e7f3e2b8340bd494c002bc205de1e4c34e261c5464ec481e50"}
Jul 21 12:52:27.696433 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.695258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6" event={"ID":"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e","Type":"ContainerStarted","Data":"5e193110cdd868122e8f0e6fef184146a0499730dee409767e52f2b9f88a6146"}
Jul 21 12:52:27.696433 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.695321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6" event={"ID":"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e","Type":"ContainerStarted","Data":"35674be77eacf3c8652140d279e250f9835be40d7549d0d130f1297cd422a650"}
Jul 21 12:52:27.696433 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.695348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6" event={"ID":"7cff7821-dfe6-49fe-b9a9-9de825ec6a9e","Type":"ContainerStarted","Data":"f2af3d83032e2691a9ba51bebcd79b35218b0d0ad5fb107ede422e734f41855a"}
Jul 21 12:52:27.700673 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.700504    2560 generic.go:356] "Generic (PLEG): container finished" podID="561024e5-b532-4812-aa86-741c66f217b2" containerID="c4bc654c287a20dd30ceb5af5516036915026ceadbdd9dfe88a27b862dd128a0" exitCode=0
Jul 21 12:52:27.700673 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.700611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcsmc" event={"ID":"561024e5-b532-4812-aa86-741c66f217b2","Type":"ContainerDied","Data":"c4bc654c287a20dd30ceb5af5516036915026ceadbdd9dfe88a27b862dd128a0"}
Jul 21 12:52:27.703659 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.703564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r" event={"ID":"057222e5-6d89-41b2-9e8f-e09f11416815","Type":"ContainerStarted","Data":"b6c2bdea3b43b011c62b3ac2d6f20e4e99412fd84be1909a6b9f6a132a658eb1"}
Jul 21 12:52:27.704879 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.704818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-md2dx" event={"ID":"ae3cc534-0d3c-4683-a118-d08b0f1d785d","Type":"ContainerStarted","Data":"94977523db23079f987ffc96d454226fd052a239d815d85b38daf385ab60f382"}
Jul 21 12:52:27.706526 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.706473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lvxc" event={"ID":"d239105b-e86f-440c-a5e0-4dcc4a1acc39","Type":"ContainerStarted","Data":"b81d6612e82563ede75e1071ff6e7d61d43bc76164da344d81f91850457c39fe"}
Jul 21 12:52:27.729198 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.729086    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-tkgl6" podStartSLOduration=1.7579486100000001 podStartE2EDuration="3.729064594s" totalImagesPullingTime="1.971115984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:27.728182648 +0000 UTC m=+67.703748516" watchObservedRunningTime="2026-07-21 12:52:27.729064594 +0000 UTC m=+67.704630644"
Jul 21 12:52:27.759792 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.759704    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-m4r4r" podStartSLOduration=2.507497673 podStartE2EDuration="3.759689741s" totalImagesPullingTime="1.252192068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:27.759337253 +0000 UTC m=+67.734903099" watchObservedRunningTime="2026-07-21 12:52:27.759689741 +0000 UTC m=+67.735255582"
Jul 21 12:52:27.769303 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:27.769273    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78954f84b9-tddfl"]
Jul 21 12:52:27.915156 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:27.915111    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf82a627_8ff4_4c65_adbe_e2f248d29624.slice/crio-e8ae9a22cdceeec7e963a8301f83b54e42b1a5eb30ab1b3bde502e3df11fa306 WatchSource:0}: Error finding container e8ae9a22cdceeec7e963a8301f83b54e42b1a5eb30ab1b3bde502e3df11fa306: Status 404 returned error can't find the container with id e8ae9a22cdceeec7e963a8301f83b54e42b1a5eb30ab1b3bde502e3df11fa306
Jul 21 12:52:28.593569 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.593535    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67c7699699-lhczq"]
Jul 21 12:52:28.597246 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.597224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.602092 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.602072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 12:52:28.604654 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.603323    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gwsft\""
Jul 21 12:52:28.604654 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.603403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 12:52:28.604654 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.603669    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 12:52:28.604654 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.603682    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-79sajcm7iqvnr\""
Jul 21 12:52:28.604654 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.603828    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 12:52:28.606935 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.606850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67c7699699-lhczq"]
Jul 21 12:52:28.710925 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.710861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.710954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-client-certs\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.711049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-tls\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.711085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bd10245-828a-4242-b37d-b39ace7a023d-audit-log\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.711119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-client-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.711213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-metrics-server-audit-profiles\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.711406 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.711250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vcgk\" (UniqueName: \"kubernetes.io/projected/3bd10245-828a-4242-b37d-b39ace7a023d-kube-api-access-2vcgk\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.713452 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.713276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"e8ae9a22cdceeec7e963a8301f83b54e42b1a5eb30ab1b3bde502e3df11fa306"}
Jul 21 12:52:28.716171 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.716145    2560 generic.go:356] "Generic (PLEG): container finished" podID="abe924a8-5055-42d2-9203-d8aac1881595" containerID="7760e3fbb9192e52376957b5fdb469ab15dd497e490d844033b7486e7ffb3bc9" exitCode=0
Jul 21 12:52:28.716278 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.716222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerDied","Data":"7760e3fbb9192e52376957b5fdb469ab15dd497e490d844033b7486e7ffb3bc9"}
Jul 21 12:52:28.721845 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.721717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcsmc" event={"ID":"561024e5-b532-4812-aa86-741c66f217b2","Type":"ContainerStarted","Data":"4e7cd24a85fe1b7eae2e098b8a3565928c23822c398f6cec2f52cea0dea7b24f"}
Jul 21 12:52:28.721845 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.721757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcsmc" event={"ID":"561024e5-b532-4812-aa86-741c66f217b2","Type":"ContainerStarted","Data":"34256f256deeb1f148d270ef7391300da20261bad579b913a71b83cbe14bc3d8"}
Jul 21 12:52:28.740919 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.740865    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:28.741428 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.741405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:28.749224 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.749181    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:28.790177 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.790115    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xcsmc" podStartSLOduration=3.218906488 podStartE2EDuration="4.790092482s" totalImagesPullingTime="1.490736337s" totalInitContainerRuntime="80.449657ms" isStatefulPod=true podCreationTimestamp="2026-07-21 12:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:28.76651469 +0000 UTC m=+68.742080536" watchObservedRunningTime="2026-07-21 12:52:28.790092482 +0000 UTC m=+68.765658326"
Jul 21 12:52:28.812784 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.812750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-client-certs\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.812955 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.812934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-tls\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.813014 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.812985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bd10245-828a-4242-b37d-b39ace7a023d-audit-log\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.813069 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.813031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-client-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.813122 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.813105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-metrics-server-audit-profiles\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.813175 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.813147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vcgk\" (UniqueName: \"kubernetes.io/projected/3bd10245-828a-4242-b37d-b39ace7a023d-kube-api-access-2vcgk\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.813423 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.813405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.814632 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.814316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.815774 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.815748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bd10245-828a-4242-b37d-b39ace7a023d-metrics-server-audit-profiles\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.815925 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.815906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bd10245-828a-4242-b37d-b39ace7a023d-audit-log\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.823140 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.823113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-client-ca-bundle\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.823903 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.823883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-client-certs\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.824890 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.824849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bd10245-828a-4242-b37d-b39ace7a023d-secret-metrics-server-tls\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.828773 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.828739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vcgk\" (UniqueName: \"kubernetes.io/projected/3bd10245-828a-4242-b37d-b39ace7a023d-kube-api-access-2vcgk\") pod \"metrics-server-67c7699699-lhczq\" (UID: \"3bd10245-828a-4242-b37d-b39ace7a023d\") " pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:28.916223 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:28.916194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:29.022879 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.022847    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"]
Jul 21 12:52:29.030712 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.030131    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.037065 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.036479    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 12:52:29.037065 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.036850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6qkqb\""
Jul 21 12:52:29.037065 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.037045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"]
Jul 21 12:52:29.102542 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.099305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67c7699699-lhczq"]
Jul 21 12:52:29.115818 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.115793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25efdf9c-b664-4b52-a613-d8418282cd7b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.116011 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.115991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bjp8\" (UniqueName: \"kubernetes.io/projected/25efdf9c-b664-4b52-a613-d8418282cd7b-kube-api-access-2bjp8\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.217250 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.217215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25efdf9c-b664-4b52-a613-d8418282cd7b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.217420 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.217263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bjp8\" (UniqueName: \"kubernetes.io/projected/25efdf9c-b664-4b52-a613-d8418282cd7b-kube-api-access-2bjp8\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.220338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.220286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25efdf9c-b664-4b52-a613-d8418282cd7b-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.226132 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.226084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bjp8\" (UniqueName: \"kubernetes.io/projected/25efdf9c-b664-4b52-a613-d8418282cd7b-kube-api-access-2bjp8\") pod \"monitoring-plugin-7b7b7bc8bf-crkgs\" (UID: \"25efdf9c-b664-4b52-a613-d8418282cd7b\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.344254 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.344223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:29.530853 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.530820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"]
Jul 21 12:52:29.534430 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:29.534371    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25efdf9c_b664_4b52_a613_d8418282cd7b.slice/crio-eeec9caddd24c7b6537a5177258688d7d1eabad986ff1882b54ec05bbc794508 WatchSource:0}: Error finding container eeec9caddd24c7b6537a5177258688d7d1eabad986ff1882b54ec05bbc794508: Status 404 returned error can't find the container with id eeec9caddd24c7b6537a5177258688d7d1eabad986ff1882b54ec05bbc794508
Jul 21 12:52:29.560849 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.559179    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d59d4755b-w5t2b"]
Jul 21 12:52:29.565787 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.564301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.570498 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.570090    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 12:52:29.570498 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.570394    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 12:52:29.570658 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.570533    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 12:52:29.570658 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.570542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vnw55\""
Jul 21 12:52:29.571016 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.570999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 12:52:29.572274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.572050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 12:52:29.575364 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.575347    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 12:52:29.584729 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.584605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d59d4755b-w5t2b"]
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-serving-certs-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-federate-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-metrics-client-ca\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtp7\" (UniqueName: \"kubernetes.io/projected/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-kube-api-access-qmtp7\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.723306 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.722808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.728505 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.728425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs" event={"ID":"25efdf9c-b664-4b52-a613-d8418282cd7b","Type":"ContainerStarted","Data":"eeec9caddd24c7b6537a5177258688d7d1eabad986ff1882b54ec05bbc794508"}
Jul 21 12:52:29.731839 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.731052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lvxc" event={"ID":"d239105b-e86f-440c-a5e0-4dcc4a1acc39","Type":"ContainerStarted","Data":"6cd60a650dbeb97fae6d52760db43112c779f77a3e8567d53fd1bad0ec32a5b5"}
Jul 21 12:52:29.731839 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.731106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lvxc" event={"ID":"d239105b-e86f-440c-a5e0-4dcc4a1acc39","Type":"ContainerStarted","Data":"1b3560ab1b2a5650481b31b286ac347fc254153e4de6a560363154b29e0d83fe"}
Jul 21 12:52:29.736408 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.734428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67c7699699-lhczq" event={"ID":"3bd10245-828a-4242-b37d-b39ace7a023d","Type":"ContainerStarted","Data":"fd5b33b98b99eb7c8059cedb50753c43648d9afb28d59f4f8214ead7f40cfb6c"}
Jul 21 12:52:29.741045 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.741002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:52:29.750054 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.749708    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7lvxc" podStartSLOduration=67.26866663 podStartE2EDuration="1m8.749690477s" totalImagesPullingTime="1.481023847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:29.748770887 +0000 UTC m=+69.724336729" watchObservedRunningTime="2026-07-21 12:52:29.749690477 +0000 UTC m=+69.725256316"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtp7\" (UniqueName: \"kubernetes.io/projected/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-kube-api-access-qmtp7\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-serving-certs-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.823907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-federate-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.824135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.827610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.824319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-metrics-client-ca\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.829573 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.829543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-serving-certs-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.831813 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.830846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-metrics-client-ca\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.832601 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.832540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.839423 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.839378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-federate-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.848014 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.847968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.848652 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.848609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-telemeter-client-tls\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.874132 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.874071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-secret-telemeter-client\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.880189 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.878108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtp7\" (UniqueName: \"kubernetes.io/projected/cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc-kube-api-access-qmtp7\") pod \"telemeter-client-d59d4755b-w5t2b\" (UID: \"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc\") " pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:29.880696 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:29.880472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b"
Jul 21 12:52:30.027426 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.027284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:30.027769 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.027690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:30.029170 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.029118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:30.036074 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.036011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddbf40d8-570d-4a80-a478-c3f3ceb951dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46rhv\" (UID: \"ddbf40d8-570d-4a80-a478-c3f3ceb951dc\") " pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:30.063995 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.063517    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d59d4755b-w5t2b"]
Jul 21 12:52:30.071176 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.070953    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzpc5\""
Jul 21 12:52:30.078656 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.078430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-46rhv"
Jul 21 12:52:30.225274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.224826    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:52:30.229966 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.229643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.242247 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.242174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:52:30.330866 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.330777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.330866 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.330834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.331091 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.331045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.331140 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.331113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7crz\" (UniqueName: \"kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.331198 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.331178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.331262 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.331212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.331262 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.331239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.432530 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.432446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7crz\" (UniqueName: \"kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.432856 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.432548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.432856 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.432594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.433539 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.432639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.433539 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.433252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.433539 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.433314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.433539 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.433387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.436610 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.436003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.439323 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.439292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.439410 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.439303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.444131 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.439775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.444922 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.444822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.446568 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.445875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.447080 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.447059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7crz\" (UniqueName: \"kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz\") pod \"console-85b75db874-g9kzf\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") " pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.545994 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.545736    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:30.548649 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.548613    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 12:52:30.560643 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.560618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.563399 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.563376    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qb9tp\""
Jul 21 12:52:30.564070 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.563917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 12:52:30.564070 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.563983    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 12:52:30.565378 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.565350    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.566554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.566808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.567038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.567257    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.567296    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 12:52:30.568397 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.567436    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 12:52:30.568859 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.568565    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 12:52:30.568919 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.567260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 12:52:30.571153 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.571131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 12:52:30.572962 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.572940    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 12:52:30.574396 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.574195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-17pdq22jvgoc0\""
Jul 21 12:52:30.576444 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.576402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 12:52:30.579039 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.578520    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 12:52:30.635677 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635677 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.635888 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdgb\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-kube-api-access-bgdgb\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.635998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636164 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636655 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.636655 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.636219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.736986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.736951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.736986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdgb\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-kube-api-access-bgdgb\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.737567 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.738863 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.737589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.738863 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.738492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.739973 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.739182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.739973 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.739682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.740143 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.740038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.744752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.741026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.744752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.741646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.744752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.743762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.744752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.744005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.744752 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.744703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.745880 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.745848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.745967 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.745927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.750743 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.750702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.752155 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.752079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.752535 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.752487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e33b47-4564-4a58-bba0-a4e31650df8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.752756 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.752734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.752986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.752869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.754043 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.754004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.755264 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.755225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.757057 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.757033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51e33b47-4564-4a58-bba0-a4e31650df8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.759167 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.759144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdgb\" (UniqueName: \"kubernetes.io/projected/51e33b47-4564-4a58-bba0-a4e31650df8d-kube-api-access-bgdgb\") pod \"prometheus-k8s-0\" (UID: \"51e33b47-4564-4a58-bba0-a4e31650df8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.882912 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:30.882874    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:30.977607 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:30.977556    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbeb7fa0_fb8d_470e_b2e9_4c105cf6bccc.slice/crio-ee56b015104b562eb81b2e6a4be72c43de50db776a8a2fae8b09d1acd32408b8 WatchSource:0}: Error finding container ee56b015104b562eb81b2e6a4be72c43de50db776a8a2fae8b09d1acd32408b8: Status 404 returned error can't find the container with id ee56b015104b562eb81b2e6a4be72c43de50db776a8a2fae8b09d1acd32408b8
Jul 21 12:52:31.747230 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:31.747184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b" event={"ID":"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc","Type":"ContainerStarted","Data":"ee56b015104b562eb81b2e6a4be72c43de50db776a8a2fae8b09d1acd32408b8"}
Jul 21 12:52:35.019077 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.019053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 12:52:35.365086 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:35.365037    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e33b47_4564_4a58_bba0_a4e31650df8d.slice/crio-d4cfa0f310286eee3d1c8803b413500454030a228c7a31e5fb55d7821a2a4851 WatchSource:0}: Error finding container d4cfa0f310286eee3d1c8803b413500454030a228c7a31e5fb55d7821a2a4851: Status 404 returned error can't find the container with id d4cfa0f310286eee3d1c8803b413500454030a228c7a31e5fb55d7821a2a4851
Jul 21 12:52:35.556865 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.556744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:52:35.575225 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:52:35.575180    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e51a9d_a97f_4fdc_9009_4063bc67d65f.slice/crio-ac5ccdcea9aa9decb0514cabdc763da5f788f2049e5adc575d59089654a2cffe WatchSource:0}: Error finding container ac5ccdcea9aa9decb0514cabdc763da5f788f2049e5adc575d59089654a2cffe: Status 404 returned error can't find the container with id ac5ccdcea9aa9decb0514cabdc763da5f788f2049e5adc575d59089654a2cffe
Jul 21 12:52:35.609437 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.609265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-46rhv"]
Jul 21 12:52:35.773880 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.773788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"d78812e079b3f808d45cea890dfbdf7ac1ff5bf68a71fa354cd07dd332e520aa"}
Jul 21 12:52:35.773986 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.773947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"3be8028e95267abb90bf3cdfb6397a157e66f7c7c8ca80e20644cb7e57251c37"}
Jul 21 12:52:35.782732 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.782356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b" event={"ID":"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc","Type":"ContainerStarted","Data":"49308c305a27c75ac6bb1d1589561631c9af878a03a14fa187cc2bb5371461f8"}
Jul 21 12:52:35.782732 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.782422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b" event={"ID":"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc","Type":"ContainerStarted","Data":"0d35a269df4d30cfb7e3fdf07a79ac8b2ec3131ad878b6dba8c3b6947067b0ef"}
Jul 21 12:52:35.784551 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.784478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67c7699699-lhczq" event={"ID":"3bd10245-828a-4242-b37d-b39ace7a023d","Type":"ContainerStarted","Data":"203c4639bd3b107653760f01fb0a4366a231fcf5a964ddd97c866747939dafab"}
Jul 21 12:52:35.789689 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.789250    2560 generic.go:356] "Generic (PLEG): container finished" podID="51e33b47-4564-4a58-bba0-a4e31650df8d" containerID="8bb480100298c12361fc9c4618ce61dee0e225bdb49c4a51c58eb5ef35721630" exitCode=0
Jul 21 12:52:35.790629 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.790031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerDied","Data":"8bb480100298c12361fc9c4618ce61dee0e225bdb49c4a51c58eb5ef35721630"}
Jul 21 12:52:35.790629 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.790107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"d4cfa0f310286eee3d1c8803b413500454030a228c7a31e5fb55d7821a2a4851"}
Jul 21 12:52:35.804827 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.804782    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67c7699699-lhczq" podStartSLOduration=1.522161749 podStartE2EDuration="7.804762276s" totalImagesPullingTime="6.282600527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:35.803940909 +0000 UTC m=+75.779506765" watchObservedRunningTime="2026-07-21 12:52:35.804762276 +0000 UTC m=+75.780328120"
Jul 21 12:52:35.809484 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.807200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtd47" event={"ID":"8f7c55e6-847f-440a-a059-661b9d2037ef","Type":"ContainerStarted","Data":"11651813ade77428c496c601cbc97d936635e93f0ca006bffcccc5a98ccb3802"}
Jul 21 12:52:35.817117 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.813121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs" event={"ID":"25efdf9c-b664-4b52-a613-d8418282cd7b","Type":"ContainerStarted","Data":"00d094553be789105d548336512d470d27b2166991f8e39a8e72c9cef81a0551"}
Jul 21 12:52:35.817117 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.813776    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:35.817117 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.816469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b75db874-g9kzf" event={"ID":"71e51a9d-a97f-4fdc-9009-4063bc67d65f","Type":"ContainerStarted","Data":"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"}
Jul 21 12:52:35.817117 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.816508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b75db874-g9kzf" event={"ID":"71e51a9d-a97f-4fdc-9009-4063bc67d65f","Type":"ContainerStarted","Data":"ac5ccdcea9aa9decb0514cabdc763da5f788f2049e5adc575d59089654a2cffe"}
Jul 21 12:52:35.825639 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.823904    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs"
Jul 21 12:52:35.825639 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.824737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"97405fb013714eea56db0b29d5fffc5be5b36b76ff2a9200446c0b2f7dfba9f6"}
Jul 21 12:52:35.825639 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.824800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"e36304cdf9f5de4965e3083261c442ac3fa08f3c9e8333efe91194e04e0c792e"}
Jul 21 12:52:35.828741 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.828699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-md2dx" event={"ID":"ae3cc534-0d3c-4683-a118-d08b0f1d785d","Type":"ContainerStarted","Data":"b939e0cca2bc1dc1bf634589ccde44526656a773f48ed0316230b0cccbfb7e65"}
Jul 21 12:52:35.829212 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.829187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:52:35.830606 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.830568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46rhv" event={"ID":"ddbf40d8-570d-4a80-a478-c3f3ceb951dc","Type":"ContainerStarted","Data":"6cc4558bbb056358ba02cb4273806ae387487a08e5cc414179e737f315b2f33d"}
Jul 21 12:52:35.892530 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.892471    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jtd47" podStartSLOduration=66.94293424 podStartE2EDuration="1m14.892439727s" totalImagesPullingTime="7.949505487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:35.887218196 +0000 UTC m=+75.862784038" watchObservedRunningTime="2026-07-21 12:52:35.892439727 +0000 UTC m=+75.868005570"
Jul 21 12:52:35.893117 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.893050    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-md2dx" podStartSLOduration=66.963323171 podStartE2EDuration="1m14.893036882s" totalImagesPullingTime="7.929713711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:35.862231178 +0000 UTC m=+75.837797020" watchObservedRunningTime="2026-07-21 12:52:35.893036882 +0000 UTC m=+75.868602726"
Jul 21 12:52:35.905959 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.905922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-crkgs" podStartSLOduration=1.043562584 podStartE2EDuration="6.905908937s" totalImagesPullingTime="5.862346353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:35.905607456 +0000 UTC m=+75.881173300" watchObservedRunningTime="2026-07-21 12:52:35.905908937 +0000 UTC m=+75.881474779"
Jul 21 12:52:35.930521 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:35.930434    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b75db874-g9kzf" podStartSLOduration=5.930413401 podStartE2EDuration="5.930413401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:35.929033767 +0000 UTC m=+75.904599643" watchObservedRunningTime="2026-07-21 12:52:35.930413401 +0000 UTC m=+75.905979246"
Jul 21 12:52:36.842686 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.842567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"4dc0609acec67c3ccc0988ec24dc2687323f00f398fc5bc8315e732263ad4b10"}
Jul 21 12:52:36.843119 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.842718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"19f82859fa5759a96e4cb107dda04ff8e5c15b3466517dbefb9397dc47c1749a"}
Jul 21 12:52:36.843119 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.842751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"5891acca18ededfa0d15722a351f7a8abddb82480d280e1aa9734fbdf8e7e481"}
Jul 21 12:52:36.845835 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.845807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"cd946f7fc3e342a44336dbbe57695050dd601e043b3d20ca4335c38b4a7b396a"}
Jul 21 12:52:36.850742 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.850292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b" event={"ID":"cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc","Type":"ContainerStarted","Data":"d18e75c80c181808e80d632c48164e2e5e4a00fe1b4274c4aa8349a505dbb0f4"}
Jul 21 12:52:36.874299 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:36.873699    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d59d4755b-w5t2b" podStartSLOduration=3.45053944 podStartE2EDuration="7.873679031s" totalImagesPullingTime="4.423139591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:36.872476901 +0000 UTC m=+76.848042744" watchObservedRunningTime="2026-07-21 12:52:36.873679031 +0000 UTC m=+76.849244874"
Jul 21 12:52:37.598485 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.598454    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:52:37.865338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.865198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abe924a8-5055-42d2-9203-d8aac1881595","Type":"ContainerStarted","Data":"f6bad93d31427bd87bbfeba4961de298f0fb078887dcdd0d6b55e3f5d6af49e4"}
Jul 21 12:52:37.872240 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.872212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"8f755248b80e776385b6b143af960caf01c8769750bbe1bc7b40d245c69d6b6a"}
Jul 21 12:52:37.872379 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.872280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"5d769a2f06c2d1891c7ee4e5ba0896380e4974c8310da3948c7fedc3ff17cb73"}
Jul 21 12:52:37.872379 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.872323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" event={"ID":"bf82a627-8ff4-4c65-adbe-e2f248d29624","Type":"ContainerStarted","Data":"bf099d2dfa614ef25b262d159e198e4238cd3124481db9a0dbebab93bfeae6e6"}
Jul 21 12:52:37.872696 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.872614    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:37.898623 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.898490    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.415523346 podStartE2EDuration="12.898466986s" totalImagesPullingTime="8.466832771s" totalInitContainerRuntime="16.110869ms" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:37.895029092 +0000 UTC m=+77.870594959" watchObservedRunningTime="2026-07-21 12:52:37.898466986 +0000 UTC m=+77.874032828"
Jul 21 12:52:37.922132 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:37.920749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl" podStartSLOduration=2.8008731 podStartE2EDuration="10.920722319s" totalImagesPullingTime="8.119849219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:37.920106067 +0000 UTC m=+77.895671911" watchObservedRunningTime="2026-07-21 12:52:37.920722319 +0000 UTC m=+77.896288164"
Jul 21 12:52:40.547276 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:40.547233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"099401f4ffc22d9f13cafe95aefce96e3984bb8b43e401e692c4a854ccd954dd"}
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"ccd48c76ea24b0dcb96e2b081aa53d60592ceafa66eaeaa0fffb4388e26911c9"}
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"0a3728d03120a0f9c77f9b369708e7ceab42e8e1310a52d989cbe9c45e0cc715"}
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"7a057a4f7c12708c821ea4364a5990f19b12dfb6ead8c36bd2be129b6b304e5f"}
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"21c9e3853a45d52fec1285541e47ad377987f23cbf5201f1e6b8e3e3cfefe333"}
Jul 21 12:52:42.904059 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.903870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51e33b47-4564-4a58-bba0-a4e31650df8d","Type":"ContainerStarted","Data":"00acfcbd2133bd97e0ebce945b49bc6360649410d732337457c51d956017bbb5"}
Jul 21 12:52:42.906080 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.906016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46rhv" event={"ID":"ddbf40d8-570d-4a80-a478-c3f3ceb951dc","Type":"ContainerStarted","Data":"8b4372865aa9532d9124f79dbdf7d37c904898cf7a7fa4e73980db7fd2b045d8"}
Jul 21 12:52:42.936985 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:42.936668    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.739714514 podStartE2EDuration="12.936647038s" totalImagesPullingTime="6.164963927s" totalInitContainerRuntime="31.968597ms" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:42.933981337 +0000 UTC m=+82.909547181" watchObservedRunningTime="2026-07-21 12:52:42.936647038 +0000 UTC m=+82.912212883"
Jul 21 12:52:43.885191 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:43.885162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78954f84b9-tddfl"
Jul 21 12:52:45.883316 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:45.883271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:52:46.926176 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:46.926137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46rhv" event={"ID":"ddbf40d8-570d-4a80-a478-c3f3ceb951dc","Type":"ContainerStarted","Data":"3b713169390386673e68a0e96a63141e6b7655ab8a51e2fd055f18f25479548d"}
Jul 21 12:52:48.571857 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:48.571825    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:52:48.917352 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:48.917314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:48.917504 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:48.917388    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:52:49.943365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:49.943336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46rhv" event={"ID":"ddbf40d8-570d-4a80-a478-c3f3ceb951dc","Type":"ContainerStarted","Data":"ecb7b345ae461a2f54ee1c8d74222b1981aeacdccb2c15c44bac49c5edaeaf6e"}
Jul 21 12:52:49.962412 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:52:49.962361    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-46rhv" podStartSLOduration=22.171571957 podStartE2EDuration="35.962345939s" totalImagesPullingTime="13.790773982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:52:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:49.961474056 +0000 UTC m=+89.937039919" watchObservedRunningTime="2026-07-21 12:52:49.962345939 +0000 UTC m=+89.937911789"
Jul 21 12:53:02.904382 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:02.904317    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85b75db874-g9kzf" podUID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" containerName="console" containerID="cri-o://4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45" gracePeriod=15
Jul 21 12:53:03.178212 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.178147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:53:03.250070 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250194 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250194 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7crz\" (UniqueName: \"kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250194 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250194 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250183    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250651 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.250821 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config\") pod \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\" (UID: \"71e51a9d-a97f-4fdc-9009-4063bc67d65f\") "
Jul 21 12:53:03.251030 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca" (OuterVolumeSpecName: "service-ca") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:03.251030 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.250968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:03.251493 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.251461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:03.251608 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.251572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config" (OuterVolumeSpecName: "console-config") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:03.252047 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.252021    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-oauth-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.252122 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.252054    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-service-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.252122 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.252077    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-trusted-ca-bundle\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.252122 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.252089    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.256905 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.253172    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:53:03.256905 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.253210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz" (OuterVolumeSpecName: "kube-api-access-m7crz") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "kube-api-access-m7crz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:53:03.258876 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.258825    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71e51a9d-a97f-4fdc-9009-4063bc67d65f" (UID: "71e51a9d-a97f-4fdc-9009-4063bc67d65f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:53:03.353392 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.353363    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.353392 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.353387    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71e51a9d-a97f-4fdc-9009-4063bc67d65f-console-oauth-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.353546 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.353397    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7crz\" (UniqueName: \"kubernetes.io/projected/71e51a9d-a97f-4fdc-9009-4063bc67d65f-kube-api-access-m7crz\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:03.999785 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.999746    2560 generic.go:356] "Generic (PLEG): container finished" podID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" containerID="4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45" exitCode=0
Jul 21 12:53:04.000255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.999808    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b75db874-g9kzf"
Jul 21 12:53:04.000255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.999817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b75db874-g9kzf" event={"ID":"71e51a9d-a97f-4fdc-9009-4063bc67d65f","Type":"ContainerDied","Data":"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"}
Jul 21 12:53:04.000255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.999867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b75db874-g9kzf" event={"ID":"71e51a9d-a97f-4fdc-9009-4063bc67d65f","Type":"ContainerDied","Data":"ac5ccdcea9aa9decb0514cabdc763da5f788f2049e5adc575d59089654a2cffe"}
Jul 21 12:53:04.000255 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:03.999895    2560 scope.go:117] "RemoveContainer" containerID="4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"
Jul 21 12:53:04.008326 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:04.008310    2560 scope.go:117] "RemoveContainer" containerID="4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"
Jul 21 12:53:04.008558 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:53:04.008536    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45\": container with ID starting with 4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45 not found: ID does not exist" containerID="4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"
Jul 21 12:53:04.008620 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:04.008568    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45"} err="failed to get container status \"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45\": rpc error: code = NotFound desc = could not find container \"4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45\": container with ID starting with 4efcc940f58f8876c2c472412eb7cbe6612be4a1b6a8eb5e99f8f492b996fd45 not found: ID does not exist"
Jul 21 12:53:04.016470 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:04.016449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:53:04.020420 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:04.020400    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b75db874-g9kzf"]
Jul 21 12:53:05.330550 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:05.330517    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" path="/var/lib/kubelet/pods/71e51a9d-a97f-4fdc-9009-4063bc67d65f/volumes"
Jul 21 12:53:07.875190 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:07.875148    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-md2dx"
Jul 21 12:53:08.922142 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:08.922111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:53:08.925907 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:08.925885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67c7699699-lhczq"
Jul 21 12:53:13.593458 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.593402    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67d7cd5679-tczpc" podUID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" containerName="console" containerID="cri-o://8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449" gracePeriod=15
Jul 21 12:53:13.874857 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.874829    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:53:13.936982 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.936958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t6pg\" (UniqueName: \"kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937149 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.936993    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937149 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937149 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937149 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937141    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937198    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert\") pod \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\" (UID: \"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a\") "
Jul 21 12:53:13.937487 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937366    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:13.937895 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:13.937895 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:13.938023 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.937897    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config" (OuterVolumeSpecName: "console-config") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:53:13.939378 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.939350    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg" (OuterVolumeSpecName: "kube-api-access-4t6pg") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "kube-api-access-4t6pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:53:13.939378 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.939354    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:53:13.939542 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:13.939402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" (UID: "cee9cdd7-0324-4fe4-bc8c-a211b8788b5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:53:14.037819 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037794    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-trusted-ca-bundle\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037819 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037819    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037829    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-oauth-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037838    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-console-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037848    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t6pg\" (UniqueName: \"kubernetes.io/projected/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-kube-api-access-4t6pg\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037858    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-oauth-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.037941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.037866    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a-service-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:53:14.042725 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.042699    2560 generic.go:356] "Generic (PLEG): container finished" podID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" containerID="8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449" exitCode=0
Jul 21 12:53:14.042825 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.042744    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7cd5679-tczpc"
Jul 21 12:53:14.042825 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.042785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7cd5679-tczpc" event={"ID":"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a","Type":"ContainerDied","Data":"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"}
Jul 21 12:53:14.042913 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.042834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7cd5679-tczpc" event={"ID":"cee9cdd7-0324-4fe4-bc8c-a211b8788b5a","Type":"ContainerDied","Data":"253b4785b96d77e9aaef7f925442e98e5adcb2f187433b171217b9498c131d31"}
Jul 21 12:53:14.042913 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.042854    2560 scope.go:117] "RemoveContainer" containerID="8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"
Jul 21 12:53:14.051383 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.051367    2560 scope.go:117] "RemoveContainer" containerID="8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"
Jul 21 12:53:14.051635 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:53:14.051619    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449\": container with ID starting with 8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449 not found: ID does not exist" containerID="8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"
Jul 21 12:53:14.051685 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.051645    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449"} err="failed to get container status \"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449\": rpc error: code = NotFound desc = could not find container \"8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449\": container with ID starting with 8cd5297971ca4f3462dcc3c36636fb87e443466e0decc510ff7d104046b83449 not found: ID does not exist"
Jul 21 12:53:14.064379 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.064355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:53:14.068402 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:14.068383    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67d7cd5679-tczpc"]
Jul 21 12:53:15.330502 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:15.330472    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" path="/var/lib/kubelet/pods/cee9cdd7-0324-4fe4-bc8c-a211b8788b5a/volumes"
Jul 21 12:53:30.883402 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:30.883371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:53:30.902440 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:30.902414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:53:31.125851 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:53:31.125824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 12:54:53.597996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.597963    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rpsrq"]
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598273    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" containerName="console"
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598284    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" containerName="console"
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598309    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" containerName="console"
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598314    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" containerName="console"
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598360    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e51a9d-a97f-4fdc-9009-4063bc67d65f" containerName="console"
Jul 21 12:54:53.598466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.598367    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cee9cdd7-0324-4fe4-bc8c-a211b8788b5a" containerName="console"
Jul 21 12:54:53.601349 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.601327    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.605948 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:54:53.605918    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-81.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-130-81.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 21 12:54:53.606064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:54:53.605976    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"cert-manager-webhook-6486ffd997-rpsrq\" is forbidden: User \"system:node:ip-10-0-130-81.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-130-81.ec2.internal' and this object" podUID="5a13e05e-7960-49c1-9536-98a585cc0642" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.606064 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:54:53.606005    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-81.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-130-81.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 21 12:54:53.614986 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:54:53.614963    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cert-manager-webhook-dockercfg-d7zzm\" is forbidden: User \"system:node:ip-10-0-130-81.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-130-81.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-d7zzm\"" type="*v1.Secret"
Jul 21 12:54:53.630154 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.630131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rpsrq"]
Jul 21 12:54:53.632960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.632937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vpd\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-kube-api-access-m8vpd\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.633041 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.632966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.734044 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.734013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vpd\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-kube-api-access-m8vpd\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.734136 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.734050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:53.750996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:53.750975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:54.743634 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:54.743602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 12:54:55.120733 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:55.120651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 12:54:55.126189 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:55.126163    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-d7zzm\""
Jul 21 12:54:55.127487 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:55.127461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vpd\" (UniqueName: \"kubernetes.io/projected/5a13e05e-7960-49c1-9536-98a585cc0642-kube-api-access-m8vpd\") pod \"cert-manager-webhook-6486ffd997-rpsrq\" (UID: \"5a13e05e-7960-49c1-9536-98a585cc0642\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:55.424916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:55.424891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:55.552066 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:55.552042    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rpsrq"]
Jul 21 12:54:55.554308 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:54:55.554272    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a13e05e_7960_49c1_9536_98a585cc0642.slice/crio-2f497aa8d9c9352e074a0022669531479a883006a1d34ead8b98a759afb6abf9 WatchSource:0}: Error finding container 2f497aa8d9c9352e074a0022669531479a883006a1d34ead8b98a759afb6abf9: Status 404 returned error can't find the container with id 2f497aa8d9c9352e074a0022669531479a883006a1d34ead8b98a759afb6abf9
Jul 21 12:54:56.428283 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:56.428234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq" event={"ID":"5a13e05e-7960-49c1-9536-98a585cc0642","Type":"ContainerStarted","Data":"2f497aa8d9c9352e074a0022669531479a883006a1d34ead8b98a759afb6abf9"}
Jul 21 12:54:59.441913 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:59.441878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq" event={"ID":"5a13e05e-7960-49c1-9536-98a585cc0642","Type":"ContainerStarted","Data":"058793d06535d851e44d80d890d89ba1a437b40dbe8bc10e4bb78388c1ff5310"}
Jul 21 12:54:59.442399 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:59.441932    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:54:59.459655 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:54:59.459613    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq" podStartSLOduration=3.342586301 podStartE2EDuration="6.459593786s" totalImagesPullingTime="3.117007485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:54:59.458452266 +0000 UTC m=+219.434018108" watchObservedRunningTime="2026-07-21 12:54:59.459593786 +0000 UTC m=+219.435159620"
Jul 21 12:55:04.701685 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.701648    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8q525"]
Jul 21 12:55:04.705221 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.705199    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.707692 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.707673    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wzbj4\""
Jul 21 12:55:04.714129 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.714108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8q525"]
Jul 21 12:55:04.829553 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.829519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.829707 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.829626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99s6\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-kube-api-access-m99s6\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.930785 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.930756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.930886 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.930808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99s6\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-kube-api-access-m99s6\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.939855 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.939828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:04.940116 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:04.940096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99s6\" (UniqueName: \"kubernetes.io/projected/397ca11d-ff08-4068-98ec-a4ab3e31a4e3-kube-api-access-m99s6\") pod \"cert-manager-55b4d954d5-8q525\" (UID: \"397ca11d-ff08-4068-98ec-a4ab3e31a4e3\") " pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:05.014479 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.014425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8q525"
Jul 21 12:55:05.135868 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.135843    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8q525"]
Jul 21 12:55:05.138096 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:55:05.138072    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod397ca11d_ff08_4068_98ec_a4ab3e31a4e3.slice/crio-26c1f86570c2536d641c4026bfb8d60a43d6a7e12424f4a366875b0a3a4bed05 WatchSource:0}: Error finding container 26c1f86570c2536d641c4026bfb8d60a43d6a7e12424f4a366875b0a3a4bed05: Status 404 returned error can't find the container with id 26c1f86570c2536d641c4026bfb8d60a43d6a7e12424f4a366875b0a3a4bed05
Jul 21 12:55:05.447175 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.447147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rpsrq"
Jul 21 12:55:05.465778 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.465750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8q525" event={"ID":"397ca11d-ff08-4068-98ec-a4ab3e31a4e3","Type":"ContainerStarted","Data":"bf0c2e6e3e16e48ce795e6bf2a04e3b5f1db94c9e47821d4427f28ad62cd30c2"}
Jul 21 12:55:05.465778 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.465780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8q525" event={"ID":"397ca11d-ff08-4068-98ec-a4ab3e31a4e3","Type":"ContainerStarted","Data":"26c1f86570c2536d641c4026bfb8d60a43d6a7e12424f4a366875b0a3a4bed05"}
Jul 21 12:55:05.485496 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:05.485444    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8q525" podStartSLOduration=1.4854258439999999 podStartE2EDuration="1.485425844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:05.483500451 +0000 UTC m=+225.459066292" watchObservedRunningTime="2026-07-21 12:55:05.485425844 +0000 UTC m=+225.460991687"
Jul 21 12:55:37.533761 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.533725    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"]
Jul 21 12:55:37.539145 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.539126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.542537 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.542511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xrbw8\""
Jul 21 12:55:37.543395 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.543379    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 12:55:37.543469 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.543449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 12:55:37.543509 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.543472    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 12:55:37.543509 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.543477    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 12:55:37.546025 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.546009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:55:37.554314 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.554293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"]
Jul 21 12:55:37.692403 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.692373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cbd5\" (UniqueName: \"kubernetes.io/projected/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-kube-api-access-5cbd5\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.692548 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.692432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.692548 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.692489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-manager-config\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.692548 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.692522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-metrics-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.793226 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.793156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cbd5\" (UniqueName: \"kubernetes.io/projected/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-kube-api-access-5cbd5\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.793226 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.793214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.793377 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.793246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-manager-config\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.793377 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.793273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-metrics-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.794007 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.793986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-manager-config\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.795904 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.795876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.795988 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.795941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-metrics-cert\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.806941 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.806916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cbd5\" (UniqueName: \"kubernetes.io/projected/bc533b6e-82d1-44fe-87fd-39b3bed4fad7-kube-api-access-5cbd5\") pod \"lws-controller-manager-54f95887b7-8scmq\" (UID: \"bc533b6e-82d1-44fe-87fd-39b3bed4fad7\") " pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.848674 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.848654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:37.985175 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:37.985155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"]
Jul 21 12:55:37.987453 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:55:37.987424    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc533b6e_82d1_44fe_87fd_39b3bed4fad7.slice/crio-acaf93c09d658acd6c7c3cdba91422bc921d3a6a97127216c727e4eace530582 WatchSource:0}: Error finding container acaf93c09d658acd6c7c3cdba91422bc921d3a6a97127216c727e4eace530582: Status 404 returned error can't find the container with id acaf93c09d658acd6c7c3cdba91422bc921d3a6a97127216c727e4eace530582
Jul 21 12:55:38.595926 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:38.595896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq" event={"ID":"bc533b6e-82d1-44fe-87fd-39b3bed4fad7","Type":"ContainerStarted","Data":"acaf93c09d658acd6c7c3cdba91422bc921d3a6a97127216c727e4eace530582"}
Jul 21 12:55:40.605959 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:40.605926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq" event={"ID":"bc533b6e-82d1-44fe-87fd-39b3bed4fad7","Type":"ContainerStarted","Data":"a315e758fdf0530046c70acaeeab18619aa2d0a1851048f9eb17caf9281cda86"}
Jul 21 12:55:40.606333 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:40.605997    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:40.625835 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:40.625789    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq" podStartSLOduration=1.189925079 podStartE2EDuration="3.625774324s" totalImagesPullingTime="2.435849245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:40.624484205 +0000 UTC m=+260.600050046" watchObservedRunningTime="2026-07-21 12:55:40.625774324 +0000 UTC m=+260.601340213"
Jul 21 12:55:42.210601 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.210546    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"]
Jul 21 12:55:42.213996 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.213970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.217349 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.217328    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 12:55:42.217799 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.217781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w8lq5\""
Jul 21 12:55:42.217903 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.217835    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 12:55:42.217962 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.217917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 12:55:42.218142 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.218124    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 12:55:42.232267 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.232355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.232355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.232355 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.232466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"]
Jul 21 12:55:42.232466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.232404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz88w\" (UniqueName: \"kubernetes.io/projected/516099c3-cf75-4deb-9f6e-3c576dba2364-kube-api-access-sz88w\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333367 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz88w\" (UniqueName: \"kubernetes.io/projected/516099c3-cf75-4deb-9f6e-3c576dba2364-kube-api-access-sz88w\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333475 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333475 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333475 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333475 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.333823 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.333803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.336031 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.336008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.336182 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.336163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516099c3-cf75-4deb-9f6e-3c576dba2364-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.336273 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.336259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/516099c3-cf75-4deb-9f6e-3c576dba2364-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.341825 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.341807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz88w\" (UniqueName: \"kubernetes.io/projected/516099c3-cf75-4deb-9f6e-3c576dba2364-kube-api-access-sz88w\") pod \"opendatahub-operator-controller-manager-59f884b5-xvrlh\" (UID: \"516099c3-cf75-4deb-9f6e-3c576dba2364\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.524270 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.524162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:42.659779 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:42.659755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"]
Jul 21 12:55:42.662421 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:55:42.662392    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516099c3_cf75_4deb_9f6e_3c576dba2364.slice/crio-c2fd5d2a5537ce140ea2074be18d432251f666c39a85841e5f4dd600f1c08e1c WatchSource:0}: Error finding container c2fd5d2a5537ce140ea2074be18d432251f666c39a85841e5f4dd600f1c08e1c: Status 404 returned error can't find the container with id c2fd5d2a5537ce140ea2074be18d432251f666c39a85841e5f4dd600f1c08e1c
Jul 21 12:55:43.622781 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:43.622711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh" event={"ID":"516099c3-cf75-4deb-9f6e-3c576dba2364","Type":"ContainerStarted","Data":"c2fd5d2a5537ce140ea2074be18d432251f666c39a85841e5f4dd600f1c08e1c"}
Jul 21 12:55:46.639517 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:46.639478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh" event={"ID":"516099c3-cf75-4deb-9f6e-3c576dba2364","Type":"ContainerStarted","Data":"96cb1f311eae885d52067756a11d0bbcb7c5f6258f2128569e12dc664aa6704b"}
Jul 21 12:55:47.645774 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:47.645729    2560 generic.go:356] "Generic (PLEG): container finished" podID="516099c3-cf75-4deb-9f6e-3c576dba2364" containerID="96cb1f311eae885d52067756a11d0bbcb7c5f6258f2128569e12dc664aa6704b" exitCode=0
Jul 21 12:55:47.646154 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:47.645807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh" event={"ID":"516099c3-cf75-4deb-9f6e-3c576dba2364","Type":"ContainerDied","Data":"96cb1f311eae885d52067756a11d0bbcb7c5f6258f2128569e12dc664aa6704b"}
Jul 21 12:55:48.651538 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:48.651504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh" event={"ID":"516099c3-cf75-4deb-9f6e-3c576dba2364","Type":"ContainerStarted","Data":"a8a655cb840b9dbf18140f841ade74b5e8b70c8340b2b14fb359efd3bb43d3eb"}
Jul 21 12:55:48.651936 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:48.651623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:55:48.688145 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:48.688091    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh" podStartSLOduration=2.229864582 podStartE2EDuration="6.68807237s" totalImagesPullingTime="3.467465603s" totalInitContainerRuntime="990.742185ms" isStatefulPod=false podCreationTimestamp="2026-07-21 12:55:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:48.682656332 +0000 UTC m=+268.658222174" watchObservedRunningTime="2026-07-21 12:55:48.68807237 +0000 UTC m=+268.663638212"
Jul 21 12:55:51.611768 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:51.611731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54f95887b7-8scmq"
Jul 21 12:55:59.658527 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:55:59.658497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-xvrlh"
Jul 21 12:56:02.467291 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.467256    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"]
Jul 21 12:56:02.478349 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.478326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.482457 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.482438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 12:56:02.482619 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.482604    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 12:56:02.482672 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.482655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fbjsw\""
Jul 21 12:56:02.483511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.483496    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 12:56:02.483564 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.483508    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 12:56:02.490394 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.490371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"]
Jul 21 12:56:02.608705 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.608666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.608705 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.608710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95fc\" (UniqueName: \"kubernetes.io/projected/c9d045d1-9f0e-44d5-b105-1e58e404ab54-kube-api-access-g95fc\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.608946 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.608791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.709536 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.709504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.709536 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.709539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g95fc\" (UniqueName: \"kubernetes.io/projected/c9d045d1-9f0e-44d5-b105-1e58e404ab54-kube-api-access-g95fc\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.709795 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.709570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.711998 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.711964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.712235 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.712215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d045d1-9f0e-44d5-b105-1e58e404ab54-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.725439 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.725383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g95fc\" (UniqueName: \"kubernetes.io/projected/c9d045d1-9f0e-44d5-b105-1e58e404ab54-kube-api-access-g95fc\") pod \"kube-auth-proxy-6d6bb59bf6-c5lq8\" (UID: \"c9d045d1-9f0e-44d5-b105-1e58e404ab54\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.788435 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.788390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"
Jul 21 12:56:02.967619 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:02.967563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8"]
Jul 21 12:56:02.970304 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:56:02.970274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d045d1_9f0e_44d5_b105_1e58e404ab54.slice/crio-0f5f23d12f96a588b9cf0ac2d4511ff7841921475b95ce74e423c8dd5cd83b8d WatchSource:0}: Error finding container 0f5f23d12f96a588b9cf0ac2d4511ff7841921475b95ce74e423c8dd5cd83b8d: Status 404 returned error can't find the container with id 0f5f23d12f96a588b9cf0ac2d4511ff7841921475b95ce74e423c8dd5cd83b8d
Jul 21 12:56:03.719647 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:03.719610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8" event={"ID":"c9d045d1-9f0e-44d5-b105-1e58e404ab54","Type":"ContainerStarted","Data":"0f5f23d12f96a588b9cf0ac2d4511ff7841921475b95ce74e423c8dd5cd83b8d"}
Jul 21 12:56:05.730357 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:05.730318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8" event={"ID":"c9d045d1-9f0e-44d5-b105-1e58e404ab54","Type":"ContainerStarted","Data":"f77c37217b5d54849b33bc3dcdb0a1205e3cc9e0224a480e619810ea63bc45d2"}
Jul 21 12:56:05.751555 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:05.751504    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-c5lq8" podStartSLOduration=1.081061424 podStartE2EDuration="3.751488182s" totalImagesPullingTime="2.670426758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:05.750381716 +0000 UTC m=+285.725947560" watchObservedRunningTime="2026-07-21 12:56:05.751488182 +0000 UTC m=+285.727054024"
Jul 21 12:56:21.188821 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:56:21.188794    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 12:57:38.019498 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.019458    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d96796dd7-4r8t5"]
Jul 21 12:57:38.023092 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.023070    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.034458 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034434    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 12:57:38.034809 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034783    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 12:57:38.034809 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034791    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 12:57:38.034966 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034791    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 12:57:38.034966 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 12:57:38.034966 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 12:57:38.034966 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.034859    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9l4m2\""
Jul 21 12:57:38.035138 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.035125    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 12:57:38.053572 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.053544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d96796dd7-4r8t5"]
Jul 21 12:57:38.060530 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.060508    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 12:57:38.081980 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.081952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7v99\" (UniqueName: \"kubernetes.io/projected/56024df1-08b3-446c-84c8-ca29dd2dfc3f-kube-api-access-g7v99\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082118 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-oauth-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082118 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082118 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-service-ca\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082118 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-trusted-ca-bundle\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.082274 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.082168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-oauth-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183043 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-oauth-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183043 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-service-ca\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-trusted-ca-bundle\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-oauth-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183386 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7v99\" (UniqueName: \"kubernetes.io/projected/56024df1-08b3-446c-84c8-ca29dd2dfc3f-kube-api-access-g7v99\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.183905 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-service-ca\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.184012 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.184012 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.183912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-oauth-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.184229 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.184208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56024df1-08b3-446c-84c8-ca29dd2dfc3f-trusted-ca-bundle\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.185701 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.185682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-serving-cert\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.185790 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.185700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56024df1-08b3-446c-84c8-ca29dd2dfc3f-console-oauth-config\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.204265 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.204235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7v99\" (UniqueName: \"kubernetes.io/projected/56024df1-08b3-446c-84c8-ca29dd2dfc3f-kube-api-access-g7v99\") pod \"console-6d96796dd7-4r8t5\" (UID: \"56024df1-08b3-446c-84c8-ca29dd2dfc3f\") " pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.332519 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.332438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:38.474820 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:38.474788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d96796dd7-4r8t5"]
Jul 21 12:57:38.477839 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:57:38.477802    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56024df1_08b3_446c_84c8_ca29dd2dfc3f.slice/crio-c4249bf66881c66fad0179843ac4da1a351d8e6294bb1a1be069f73974772631 WatchSource:0}: Error finding container c4249bf66881c66fad0179843ac4da1a351d8e6294bb1a1be069f73974772631: Status 404 returned error can't find the container with id c4249bf66881c66fad0179843ac4da1a351d8e6294bb1a1be069f73974772631
Jul 21 12:57:39.139079 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:39.139043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d96796dd7-4r8t5" event={"ID":"56024df1-08b3-446c-84c8-ca29dd2dfc3f","Type":"ContainerStarted","Data":"7d802b3cb3ac74433ac34d041f4643a11156205d50296222af6dc2c8cf729eaa"}
Jul 21 12:57:39.139565 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:39.139098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d96796dd7-4r8t5" event={"ID":"56024df1-08b3-446c-84c8-ca29dd2dfc3f","Type":"ContainerStarted","Data":"c4249bf66881c66fad0179843ac4da1a351d8e6294bb1a1be069f73974772631"}
Jul 21 12:57:46.967678 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.967629    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d96796dd7-4r8t5" podStartSLOduration=9.967611687 podStartE2EDuration="9.967611687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:39.201053745 +0000 UTC m=+379.176619588" watchObservedRunningTime="2026-07-21 12:57:46.967611687 +0000 UTC m=+386.943177530"
Jul 21 12:57:46.968521 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.968503    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"]
Jul 21 12:57:46.971976 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.971960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:57:46.974724 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.974701    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 12:57:46.975353 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.975336    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cnd8f\""
Jul 21 12:57:46.975780 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.975767    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 12:57:46.980667 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.980653    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 12:57:46.991141 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:46.991117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"]
Jul 21 12:57:47.062503 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.062476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7sbs\" (UniqueName: \"kubernetes.io/projected/36f24332-7ef8-4a7e-9a64-25c2d51ed9b5-kube-api-access-s7sbs\") pod \"dns-operator-controller-manager-864dd78c4c-lzpfg\" (UID: \"36f24332-7ef8-4a7e-9a64-25c2d51ed9b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:57:47.163466 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.163436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7sbs\" (UniqueName: \"kubernetes.io/projected/36f24332-7ef8-4a7e-9a64-25c2d51ed9b5-kube-api-access-s7sbs\") pod \"dns-operator-controller-manager-864dd78c4c-lzpfg\" (UID: \"36f24332-7ef8-4a7e-9a64-25c2d51ed9b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:57:47.179658 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.179639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7sbs\" (UniqueName: \"kubernetes.io/projected/36f24332-7ef8-4a7e-9a64-25c2d51ed9b5-kube-api-access-s7sbs\") pod \"dns-operator-controller-manager-864dd78c4c-lzpfg\" (UID: \"36f24332-7ef8-4a7e-9a64-25c2d51ed9b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:57:47.282309 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.282255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:57:47.437671 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.437647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"]
Jul 21 12:57:47.440430 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:57:47.440405    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f24332_7ef8_4a7e_9a64_25c2d51ed9b5.slice/crio-693b87d5768377f819b58746a199e7bef4f94ef388e2b8fae7839d2bc2b09045 WatchSource:0}: Error finding container 693b87d5768377f819b58746a199e7bef4f94ef388e2b8fae7839d2bc2b09045: Status 404 returned error can't find the container with id 693b87d5768377f819b58746a199e7bef4f94ef388e2b8fae7839d2bc2b09045
Jul 21 12:57:47.442360 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:47.442344    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 12:57:48.183744 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:48.183706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg" event={"ID":"36f24332-7ef8-4a7e-9a64-25c2d51ed9b5","Type":"ContainerStarted","Data":"693b87d5768377f819b58746a199e7bef4f94ef388e2b8fae7839d2bc2b09045"}
Jul 21 12:57:48.333427 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:48.333392    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:48.333604 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:48.333467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:48.338522 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:48.338497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:49.194322 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:49.194292    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d96796dd7-4r8t5"
Jul 21 12:57:50.195338 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.195300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg" event={"ID":"36f24332-7ef8-4a7e-9a64-25c2d51ed9b5","Type":"ContainerStarted","Data":"50ffee8828a788e6d4934aa792ea74e329020881c7a00eecfced336eb1cb5c5e"}
Jul 21 12:57:50.221672 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.221623    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg" podStartSLOduration=2.133134085 podStartE2EDuration="4.221609431s" totalImagesPullingTime="2.088475346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:50.220299725 +0000 UTC m=+390.195865568" watchObservedRunningTime="2026-07-21 12:57:50.221609431 +0000 UTC m=+390.197175272"
Jul 21 12:57:50.412618 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.412590    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"]
Jul 21 12:57:50.415951 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.415933    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.418960 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.418937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 12:57:50.419433 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.419413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 12:57:50.419535 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.419520    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s7px4\""
Jul 21 12:57:50.437537 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.437509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"]
Jul 21 12:57:50.493369 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.493289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fdc815-495a-487b-b5ea-f28cab20e37c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.493369 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.493344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99fdc815-495a-487b-b5ea-f28cab20e37c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.493369 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.493361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8j9\" (UniqueName: \"kubernetes.io/projected/99fdc815-495a-487b-b5ea-f28cab20e37c-kube-api-access-8w8j9\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.593916 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.593882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fdc815-495a-487b-b5ea-f28cab20e37c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.594052 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.593947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99fdc815-495a-487b-b5ea-f28cab20e37c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.594052 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.593973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8j9\" (UniqueName: \"kubernetes.io/projected/99fdc815-495a-487b-b5ea-f28cab20e37c-kube-api-access-8w8j9\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.594631 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.594609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99fdc815-495a-487b-b5ea-f28cab20e37c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.596003 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.595982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fdc815-495a-487b-b5ea-f28cab20e37c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.607622 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.607597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8j9\" (UniqueName: \"kubernetes.io/projected/99fdc815-495a-487b-b5ea-f28cab20e37c-kube-api-access-8w8j9\") pod \"kuadrant-console-plugin-66b5774985-q55gt\" (UID: \"99fdc815-495a-487b-b5ea-f28cab20e37c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.731895 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.731874    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"
Jul 21 12:57:50.857655 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:50.857630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt"]
Jul 21 12:57:50.859685 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:57:50.859658    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99fdc815_495a_487b_b5ea_f28cab20e37c.slice/crio-9aa96ba378101dd7da915b7ab8dee27a0d8f8e30ef977d7cc15ce86bc4058817 WatchSource:0}: Error finding container 9aa96ba378101dd7da915b7ab8dee27a0d8f8e30ef977d7cc15ce86bc4058817: Status 404 returned error can't find the container with id 9aa96ba378101dd7da915b7ab8dee27a0d8f8e30ef977d7cc15ce86bc4058817
Jul 21 12:57:51.205365 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:51.205326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt" event={"ID":"99fdc815-495a-487b-b5ea-f28cab20e37c","Type":"ContainerStarted","Data":"9aa96ba378101dd7da915b7ab8dee27a0d8f8e30ef977d7cc15ce86bc4058817"}
Jul 21 12:57:51.205774 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:57:51.205523    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:58:02.213381 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:02.213346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzpfg"
Jul 21 12:58:12.319001 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:12.318962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt" event={"ID":"99fdc815-495a-487b-b5ea-f28cab20e37c","Type":"ContainerStarted","Data":"b3849337217f228fabcef4f6e82fed44c013a3dd0173ee965e74b747956f14b4"}
Jul 21 12:58:12.337266 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:12.337005    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q55gt" podStartSLOduration=1.12691919 podStartE2EDuration="22.336991295s" totalImagesPullingTime="21.210072105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:12.336109651 +0000 UTC m=+412.311675493" watchObservedRunningTime="2026-07-21 12:58:12.336991295 +0000 UTC m=+412.312557137"
Jul 21 12:58:33.417600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.409941    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 12:58:33.417600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.413942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.417600 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.417535    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 12:58:33.425127 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.425105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 12:58:33.462390 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.462358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 12:58:33.484076 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.484041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzv45\" (UniqueName: \"kubernetes.io/projected/f882d997-62c5-439d-8c31-35f5b45b6ef3-kube-api-access-hzv45\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.484218 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.484103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f882d997-62c5-439d-8c31-35f5b45b6ef3-config-file\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.585115 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.585080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzv45\" (UniqueName: \"kubernetes.io/projected/f882d997-62c5-439d-8c31-35f5b45b6ef3-kube-api-access-hzv45\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.585303 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.585135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f882d997-62c5-439d-8c31-35f5b45b6ef3-config-file\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.585723 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.585705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f882d997-62c5-439d-8c31-35f5b45b6ef3-config-file\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.595319 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.595297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzv45\" (UniqueName: \"kubernetes.io/projected/f882d997-62c5-439d-8c31-35f5b45b6ef3-kube-api-access-hzv45\") pod \"limitador-limitador-54d6d988d5-cctk8\" (UID: \"f882d997-62c5-439d-8c31-35f5b45b6ef3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.726412 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.726318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:33.866851 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:33.866817    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 12:58:33.868809 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:58:33.868772    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf882d997_62c5_439d_8c31_35f5b45b6ef3.slice/crio-e22b0382ed99848b90351c947b27e12ec33caabe37d9fc422437c7fb332c1766 WatchSource:0}: Error finding container e22b0382ed99848b90351c947b27e12ec33caabe37d9fc422437c7fb332c1766: Status 404 returned error can't find the container with id e22b0382ed99848b90351c947b27e12ec33caabe37d9fc422437c7fb332c1766
Jul 21 12:58:34.030732 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.030646    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:58:34.033824 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.033801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:58:34.036727 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.036708    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-88scf\""
Jul 21 12:58:34.041308 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.041069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:58:34.090032 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.090008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzjd\" (UniqueName: \"kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd\") pod \"authorino-75d556bd77-zpnv6\" (UID: \"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe\") " pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:58:34.190648 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.190614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzjd\" (UniqueName: \"kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd\") pod \"authorino-75d556bd77-zpnv6\" (UID: \"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe\") " pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:58:34.199915 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.199884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzjd\" (UniqueName: \"kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd\") pod \"authorino-75d556bd77-zpnv6\" (UID: \"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe\") " pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:58:34.344180 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.344113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:58:34.423511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.423482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8" event={"ID":"f882d997-62c5-439d-8c31-35f5b45b6ef3","Type":"ContainerStarted","Data":"e22b0382ed99848b90351c947b27e12ec33caabe37d9fc422437c7fb332c1766"}
Jul 21 12:58:34.508695 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:34.508658    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:58:34.514086 ip-10-0-130-81 kubenswrapper[2560]: W0721 12:58:34.514056    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63e6cf22_62c8_4e0d_ae28_31fd3d5c2dfe.slice/crio-c21e3ce505a16c2b48317d7b5d9871767b927516830402dbdb5c1639d70e2d5c WatchSource:0}: Error finding container c21e3ce505a16c2b48317d7b5d9871767b927516830402dbdb5c1639d70e2d5c: Status 404 returned error can't find the container with id c21e3ce505a16c2b48317d7b5d9871767b927516830402dbdb5c1639d70e2d5c
Jul 21 12:58:35.433430 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:35.433386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpnv6" event={"ID":"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe","Type":"ContainerStarted","Data":"c21e3ce505a16c2b48317d7b5d9871767b927516830402dbdb5c1639d70e2d5c"}
Jul 21 12:58:38.450426 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:38.450355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpnv6" event={"ID":"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe","Type":"ContainerStarted","Data":"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"}
Jul 21 12:58:38.452091 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:38.452031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8" event={"ID":"f882d997-62c5-439d-8c31-35f5b45b6ef3","Type":"ContainerStarted","Data":"88c06150a7d1a7374b7c075a83d7585ded80268e2db511b5893f43f08f5cd2b5"}
Jul 21 12:58:38.452196 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:38.452171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:58:38.465625 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:38.465558    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zpnv6" podStartSLOduration=0.644163283 podStartE2EDuration="4.465543957s" totalImagesPullingTime="3.821380674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:38.46414725 +0000 UTC m=+438.439713093" watchObservedRunningTime="2026-07-21 12:58:38.465543957 +0000 UTC m=+438.441109799"
Jul 21 12:58:38.481511 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:38.481461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8" podStartSLOduration=1.021830481 podStartE2EDuration="5.481441036s" totalImagesPullingTime="4.459610555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:38.480428227 +0000 UTC m=+438.455994071" watchObservedRunningTime="2026-07-21 12:58:38.481441036 +0000 UTC m=+438.457006879"
Jul 21 12:58:49.458464 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:58:49.458370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cctk8"
Jul 21 12:59:09.764027 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:09.763992    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:59:09.764569 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:09.764198    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zpnv6" podUID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" containerName="authorino" containerID="cri-o://1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7" gracePeriod=30
Jul 21 12:59:10.036744 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.036683    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:59:10.086912 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.086886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltzjd\" (UniqueName: \"kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd\") pod \"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe\" (UID: \"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe\") "
Jul 21 12:59:10.088970 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.088929    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd" (OuterVolumeSpecName: "kube-api-access-ltzjd") pod "63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" (UID: "63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe"). InnerVolumeSpecName "kube-api-access-ltzjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:59:10.187489 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.187460    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltzjd\" (UniqueName: \"kubernetes.io/projected/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe-kube-api-access-ltzjd\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 12:59:10.611917 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.611883    2560 generic.go:356] "Generic (PLEG): container finished" podID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" containerID="1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7" exitCode=0
Jul 21 12:59:10.612108 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.611932    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpnv6"
Jul 21 12:59:10.612108 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.611972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpnv6" event={"ID":"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe","Type":"ContainerDied","Data":"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"}
Jul 21 12:59:10.612108 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.612014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpnv6" event={"ID":"63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe","Type":"ContainerDied","Data":"c21e3ce505a16c2b48317d7b5d9871767b927516830402dbdb5c1639d70e2d5c"}
Jul 21 12:59:10.612108 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.612032    2560 scope.go:117] "RemoveContainer" containerID="1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"
Jul 21 12:59:10.632627 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.632599    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:59:10.636667 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.636633    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpnv6"]
Jul 21 12:59:10.639971 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.639952    2560 scope.go:117] "RemoveContainer" containerID="1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"
Jul 21 12:59:10.640284 ip-10-0-130-81 kubenswrapper[2560]: E0721 12:59:10.640266    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7\": container with ID starting with 1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7 not found: ID does not exist" containerID="1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"
Jul 21 12:59:10.640324 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:10.640291    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7"} err="failed to get container status \"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7\": rpc error: code = NotFound desc = could not find container \"1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7\": container with ID starting with 1762aa07c4e9aecd672d9ff738890583a468dcb2526cd4176c8d6ccf5bc9fcc7 not found: ID does not exist"
Jul 21 12:59:11.331441 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:11.331404    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" path="/var/lib/kubelet/pods/63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe/volumes"
Jul 21 12:59:50.563989 ip-10-0-130-81 kubenswrapper[2560]: I0721 12:59:50.563948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:16.921768 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:16.921692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:31.632176 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:31.632139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:37.222202 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.222166    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"]
Jul 21 13:00:37.223042 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.222752    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" containerName="authorino"
Jul 21 13:00:37.223042 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.222773    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" containerName="authorino"
Jul 21 13:00:37.223042 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.222882    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e6cf22-62c8-4e0d-ae28-31fd3d5c2dfe" containerName="authorino"
Jul 21 13:00:37.226092 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.226071    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.229780 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.229757    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 13:00:37.229884 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.229777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 13:00:37.229884 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.229815    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 13:00:37.229968 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.229912    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dv5rb\""
Jul 21 13:00:37.236333 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.236311    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"]
Jul 21 13:00:37.360881 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.360852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9smn\" (UniqueName: \"kubernetes.io/projected/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-kube-api-access-h9smn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.361029 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.360887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.361029 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.360957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.361029 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.360982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.361157 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.361044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.361157 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.361075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462255 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462359 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462359 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9smn\" (UniqueName: \"kubernetes.io/projected/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-kube-api-access-h9smn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462359 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462483 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462483 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462765 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462886 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.462886 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.462812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.464546 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.464523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.464873 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.464855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.469958 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.469932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9smn\" (UniqueName: \"kubernetes.io/projected/d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a-kube-api-access-h9smn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5x6q\" (UID: \"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.536738 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.536680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:00:37.673895 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:37.673872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"]
Jul 21 13:00:37.676150 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:00:37.676122    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ade13d_a8f1_4e8d_9ed6_aff32fdbba6a.slice/crio-7b43fcec7df738cc9d71bdbf0a07c68b9c15f3dbf8a8abf3108893e0b920873b WatchSource:0}: Error finding container 7b43fcec7df738cc9d71bdbf0a07c68b9c15f3dbf8a8abf3108893e0b920873b: Status 404 returned error can't find the container with id 7b43fcec7df738cc9d71bdbf0a07c68b9c15f3dbf8a8abf3108893e0b920873b
Jul 21 13:00:38.020304 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:38.020268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q" event={"ID":"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a","Type":"ContainerStarted","Data":"7b43fcec7df738cc9d71bdbf0a07c68b9c15f3dbf8a8abf3108893e0b920873b"}
Jul 21 13:00:38.417668 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:38.417630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:41.928741 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:41.928709    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"]
Jul 21 13:00:41.933547 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:41.933526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:41.936192 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:41.936173    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 13:00:41.943852 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:41.943830    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"]
Jul 21 13:00:42.001595 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.001595 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.001823 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.001823 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.001823 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx4l6\" (UniqueName: \"kubernetes.io/projected/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-kube-api-access-hx4l6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.001823 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.001814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103005 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.102967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103005 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103203 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103203 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103203 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx4l6\" (UniqueName: \"kubernetes.io/projected/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-kube-api-access-hx4l6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103203 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103445 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103485 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.103532 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.103498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.105433 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.105417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.105714 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.105696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.111505 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.111482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx4l6\" (UniqueName: \"kubernetes.io/projected/e5ba79c9-97eb-48bb-9427-1c9d5580f8cc-kube-api-access-hx4l6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk\" (UID: \"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.244111 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.244023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:00:42.378883 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:42.378818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"]
Jul 21 13:00:42.381351 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:00:42.381326    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ba79c9_97eb_48bb_9427_1c9d5580f8cc.slice/crio-23ca863e3b44f96bc9c65a6dbab5c0096b673a42b4d37589933f7cdc4331bd28 WatchSource:0}: Error finding container 23ca863e3b44f96bc9c65a6dbab5c0096b673a42b4d37589933f7cdc4331bd28: Status 404 returned error can't find the container with id 23ca863e3b44f96bc9c65a6dbab5c0096b673a42b4d37589933f7cdc4331bd28
Jul 21 13:00:43.044962 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:43.044926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk" event={"ID":"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc","Type":"ContainerStarted","Data":"23ca863e3b44f96bc9c65a6dbab5c0096b673a42b4d37589933f7cdc4331bd28"}
Jul 21 13:00:43.720844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:43.720811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:52.517863 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:52.517827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:00:54.819699 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.819653    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"]
Jul 21 13:00:54.823632 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.823614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.826164 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.826147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 13:00:54.830676 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.830653    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"]
Jul 21 13:00:54.918040 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.917999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84q2h\" (UniqueName: \"kubernetes.io/projected/7588f29c-fc31-4a26-a150-7c3080a419ad-kube-api-access-84q2h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.918207 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.918053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.918207 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.918149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.918207 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.918180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.918318 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.918216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:54.918318 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:54.918286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7588f29c-fc31-4a26-a150-7c3080a419ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019011 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.018980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84q2h\" (UniqueName: \"kubernetes.io/projected/7588f29c-fc31-4a26-a150-7c3080a419ad-kube-api-access-84q2h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019367 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7588f29c-fc31-4a26-a150-7c3080a419ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019522 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019603 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.019603 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.019551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.021359 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.021341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7588f29c-fc31-4a26-a150-7c3080a419ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.021615 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.021596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7588f29c-fc31-4a26-a150-7c3080a419ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.028076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.028057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84q2h\" (UniqueName: \"kubernetes.io/projected/7588f29c-fc31-4a26-a150-7c3080a419ad-kube-api-access-84q2h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj\" (UID: \"7588f29c-fc31-4a26-a150-7c3080a419ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.134906 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.134815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:00:55.277665 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:55.277639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"]
Jul 21 13:00:56.108274 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:00:56.108241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj" event={"ID":"7588f29c-fc31-4a26-a150-7c3080a419ad","Type":"ContainerStarted","Data":"73ec3b829c742041809d87906e185f2b0e3f0e38e170ba3fa7c16220f0346bf7"}
Jul 21 13:01:02.138007 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:02.137967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk" event={"ID":"e5ba79c9-97eb-48bb-9427-1c9d5580f8cc","Type":"ContainerStarted","Data":"b6cb02c580bf7ffb7a519a2132d76dc5e1ced4ab3427792d9c3034111209acec"}
Jul 21 13:01:02.159181 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:02.159131    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk" podStartSLOduration=2.446884168 podStartE2EDuration="21.15911648s" totalImagesPullingTime="18.712232312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:01:02.158051446 +0000 UTC m=+582.133617289" watchObservedRunningTime="2026-07-21 13:01:02.15911648 +0000 UTC m=+582.134682322"
Jul 21 13:01:02.244815 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:02.244795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:01:02.244954 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:02.244838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:01:02.257162 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:02.257141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:01:03.154271 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:03.154241    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk"
Jul 21 13:01:04.819392 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:04.819359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:01:10.177076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:10.177037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q" event={"ID":"d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a","Type":"ContainerStarted","Data":"b999d7308e71f679d707f3391805adf6c47f949d19191730261ac3aa6fb12081"}
Jul 21 13:01:10.178650 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:10.178622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj" event={"ID":"7588f29c-fc31-4a26-a150-7c3080a419ad","Type":"ContainerStarted","Data":"0d61c261dcbca79311f54bfeed875835177425b8ac1001f5f9f9bbc805a23958"}
Jul 21 13:01:10.195587 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:10.195546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q" podStartSLOduration=1.307837564 podStartE2EDuration="33.195532742s" totalImagesPullingTime="31.887695178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:01:10.195067452 +0000 UTC m=+590.170633296" watchObservedRunningTime="2026-07-21 13:01:10.195532742 +0000 UTC m=+590.171098585"
Jul 21 13:01:10.214077 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:10.214037    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj" podStartSLOduration=2.339045228 podStartE2EDuration="16.214024194s" totalImagesPullingTime="13.874978966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:01:10.213072849 +0000 UTC m=+590.188638692" watchObservedRunningTime="2026-07-21 13:01:10.214024194 +0000 UTC m=+590.189590033"
Jul 21 13:01:15.135439 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:15.135404    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:01:15.135886 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:15.135454    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:01:15.147882 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:15.147858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:01:15.214206 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:15.214184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj"
Jul 21 13:01:17.537021 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:17.536983    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:01:17.537396 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:17.537041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:01:17.549449 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:17.549422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:01:18.228298 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:01:18.228264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5x6q"
Jul 21 13:03:06.726278 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:03:06.726244    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:03:16.529698 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:03:16.529610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:03:26.341432 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:03:26.341402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:05:08.631413 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:05:08.631378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:05:16.524836 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:05:16.524795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:05:49.523803 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:05:49.523766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:05:59.321985 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:05:59.321956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:06:08.224948 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:06:08.224907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:06:18.024407 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:06:18.024332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:06:28.726884 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:06:28.726844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:06:38.325188 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:06:38.325149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:06:50.814047 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:06:50.814008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:07:00.230321 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:07:00.230287    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:07:25.221396 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:07:25.221361    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:07:37.324269 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:07:37.324233    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:04.220864 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:04.220828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:14.618121 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:14.618091    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:21.016219 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:21.016183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:33.228536 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:33.228492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:43.221879 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:43.221839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:08:54.719760 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:08:54.719727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:09:04.118637 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:09:04.118599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:09:14.016406 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:09:14.016324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:03.623450 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:03.623418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:15.518975 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:15.518940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:24.113637 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:24.113602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:36.529374 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:36.529313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:48.023874 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:48.023830    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:11:58.824781 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:11:58.824745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:12:08.625532 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:12:08.625497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:12:18.021905 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:12:18.021820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:12:29.130783 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:12:29.130745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:12:38.232318 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:12:38.232283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:12:49.818390 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:12:49.818355    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:13:15.115476 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:15.115431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:13:22.527289 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:22.527254    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:13:32.536001 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:32.535955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:13:39.131740 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.131702    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:13:39.134929 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.134913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.137660 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.137635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-35ceff91-kserve-self-signed-certs\""
Jul 21 13:13:39.147788 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.147767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:13:39.198516 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.198642 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.198642 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.198726 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4nrz\" (UniqueName: \"kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.198726 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.198726 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.198698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.299912 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.299887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300023 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.299937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300023 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.299960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300023 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.299988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4nrz\" (UniqueName: \"kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300023 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.300007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300023 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.300023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300427 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.300396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300427 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.300407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.300548 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.300463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.302205 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.302184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.302442 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.302424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.308847 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.308823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4nrz\" (UniqueName: \"kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz\") pod \"e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") " pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.445592 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.445546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:39.576611 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.576564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:13:39.579371 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:13:39.579341    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07c5b604_9d88_4c32_8932_a33fa5e5ee21.slice/crio-18236b5dc73f1e470671aff73fcfdf9f68c3dd232f4eb3b4900880caf6efa762 WatchSource:0}: Error finding container 18236b5dc73f1e470671aff73fcfdf9f68c3dd232f4eb3b4900880caf6efa762: Status 404 returned error can't find the container with id 18236b5dc73f1e470671aff73fcfdf9f68c3dd232f4eb3b4900880caf6efa762
Jul 21 13:13:39.758345 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.758267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" event={"ID":"07c5b604-9d88-4c32-8932-a33fa5e5ee21","Type":"ContainerStarted","Data":"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"}
Jul 21 13:13:39.758345 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.758310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" event={"ID":"07c5b604-9d88-4c32-8932-a33fa5e5ee21","Type":"ContainerStarted","Data":"18236b5dc73f1e470671aff73fcfdf9f68c3dd232f4eb3b4900880caf6efa762"}
Jul 21 13:13:39.777442 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:39.777399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" podStartSLOduration=0.777384617 podStartE2EDuration="777.384617ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:13:39.775447606 +0000 UTC m=+1339.751013450" watchObservedRunningTime="2026-07-21 13:13:39.777384617 +0000 UTC m=+1339.752950458"
Jul 21 13:13:49.446723 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:49.446637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:49.446723 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:49.446711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:49.459044 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:49.459015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:49.816279 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:49.816202    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:13:51.521692 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:13:51.521652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:14:23.006735 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:23.006703    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:14:26.133491 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:26.133458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:14:38.027317 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.027256    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" podUID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" containerName="main" containerID="cri-o://453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562" gracePeriod=45
Jul 21 13:14:38.274319 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.274295    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:14:38.452124 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452257 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452257 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452257 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452371 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4nrz\" (UniqueName: \"kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452371 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452329    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home\") pod \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\" (UID: \"07c5b604-9d88-4c32-8932-a33fa5e5ee21\") "
Jul 21 13:14:38.452511 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452475    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache" (OuterVolumeSpecName: "model-cache") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:14:38.452602 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:14:38.452680 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452652    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home" (OuterVolumeSpecName: "home") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:14:38.452730 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452715    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:38.452782 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.452734    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:38.454391 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.454367    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm" (OuterVolumeSpecName: "dshm") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:14:38.454475 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.454455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz" (OuterVolumeSpecName: "kube-api-access-m4nrz") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "kube-api-access-m4nrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:14:38.454515 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.454458    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07c5b604-9d88-4c32-8932-a33fa5e5ee21" (UID: "07c5b604-9d88-4c32-8932-a33fa5e5ee21"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:14:38.553677 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.553655    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4nrz\" (UniqueName: \"kubernetes.io/projected/07c5b604-9d88-4c32-8932-a33fa5e5ee21-kube-api-access-m4nrz\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:38.553677 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.553677    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:38.553801 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.553687    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07c5b604-9d88-4c32-8932-a33fa5e5ee21-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:38.553801 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:38.553695    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07c5b604-9d88-4c32-8932-a33fa5e5ee21-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:14:39.041759 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.041726    2560 generic.go:356] "Generic (PLEG): container finished" podID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" containerID="453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562" exitCode=0
Jul 21 13:14:39.042118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.041766    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"
Jul 21 13:14:39.042118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.041815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" event={"ID":"07c5b604-9d88-4c32-8932-a33fa5e5ee21","Type":"ContainerDied","Data":"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"}
Jul 21 13:14:39.042118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.041859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6" event={"ID":"07c5b604-9d88-4c32-8932-a33fa5e5ee21","Type":"ContainerDied","Data":"18236b5dc73f1e470671aff73fcfdf9f68c3dd232f4eb3b4900880caf6efa762"}
Jul 21 13:14:39.042118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.041878    2560 scope.go:117] "RemoveContainer" containerID="453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"
Jul 21 13:14:39.050863 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.050847    2560 scope.go:117] "RemoveContainer" containerID="453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"
Jul 21 13:14:39.051080 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:14:39.051062    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562\": container with ID starting with 453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562 not found: ID does not exist" containerID="453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"
Jul 21 13:14:39.051140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.051086    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562"} err="failed to get container status \"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562\": rpc error: code = NotFound desc = could not find container \"453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562\": container with ID starting with 453b12289a3f6cb79fb4ddef80e8f301fe15c310e3c18a4ff1ab3479da963562 not found: ID does not exist"
Jul 21 13:14:39.065340 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.065316    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:14:39.070353 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.070334    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-35ceff91-kserve-69dfb8b947-bt8k6"]
Jul 21 13:14:39.330868 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:39.330802    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" path="/var/lib/kubelet/pods/07c5b604-9d88-4c32-8932-a33fa5e5ee21/volumes"
Jul 21 13:14:40.131041 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:40.131011    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:14:46.734870 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:14:46.734831    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:03.571613 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:03.571559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:12.921030 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:12.920935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:22.429539 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:22.429504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:34.032985 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:34.032947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:43.632103 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:43.632065    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:15:53.539032 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:15:53.538998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:03.930433 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:03.930399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:21.429005 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:21.428974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:31.647653 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:31.647620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:39.265808 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:39.265772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:48.839265 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:48.839174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:16:59.002881 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:16:59.002847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:17:11.526742 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:17:11.526703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:17:22.847592 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:17:22.847543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:17:32.222555 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:17:32.222520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:17:54.227058 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:17:54.227022    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:18:26.242288 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:18:26.242256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:18:38.627384 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:18:38.627354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:19:10.240954 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:19:10.240916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:19:21.121386 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:19:21.121350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:19:55.338558 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:19:55.338522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:20:07.836697 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:20:07.836662    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:20:43.528633 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:20:43.528598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:22:11.819116 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:22:11.819084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:22:21.426404 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:22:21.426372    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:22:33.840322 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:22:33.840285    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:22:54.126735 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:22:54.126699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:23:32.620886 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:23:32.620852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:23:50.317079 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:23:50.317044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:24:07.622359 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:24:07.622327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:24:28.352748 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:24:28.352673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:24:39.421961 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:24:39.421923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:25:29.135636 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:25:29.135599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:25:41.941592 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:25:41.941542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:26:30.145624 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:30.145589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:26:46.337824 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:46.337783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:26:58.773959 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.773910    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:26:58.774350 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.774322    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" containerName="main"
Jul 21 13:26:58.774350 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.774334    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" containerName="main"
Jul 21 13:26:58.774431 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.774408    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="07c5b604-9d88-4c32-8932-a33fa5e5ee21" containerName="main"
Jul 21 13:26:58.777447 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.777431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.781521 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.781488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d1dafe\"/\"openshift-service-ca.crt\""
Jul 21 13:26:58.781682 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.781663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d1dafe\"/\"default-dockercfg-8tlgl\""
Jul 21 13:26:58.782518 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.782504    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d1dafe\"/\"test-model-d1dafe-kserve-self-signed-certs\""
Jul 21 13:26:58.782774 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.782757    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d1dafe\"/\"kube-root-ca.crt\""
Jul 21 13:26:58.799466 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.799438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:26:58.921727 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.921892 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.921892 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.921892 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h97h7\" (UniqueName: \"kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.921892 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:58.921892 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:58.921892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.022977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h97h7\" (UniqueName: \"kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023572 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023688 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.023688 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.023677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.025443 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.025389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.025613 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.025596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.034236 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.034195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h97h7\" (UniqueName: \"kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7\") pod \"test-model-d1dafe-kserve-6d857c4787-f29nk\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") " pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.086222 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.086191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:26:59.227787 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.227758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:26:59.229543 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:26:59.229518    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d5ac742_0517_40a4_b33f_d3f22a25770d.slice/crio-5b749636defed442ac9d0ec68c147c4b48ebf00a51b44569aebda088bd488403 WatchSource:0}: Error finding container 5b749636defed442ac9d0ec68c147c4b48ebf00a51b44569aebda088bd488403: Status 404 returned error can't find the container with id 5b749636defed442ac9d0ec68c147c4b48ebf00a51b44569aebda088bd488403
Jul 21 13:26:59.623716 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.623631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" event={"ID":"1d5ac742-0517-40a4-b33f-d3f22a25770d","Type":"ContainerStarted","Data":"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"}
Jul 21 13:26:59.623716 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.623681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" event={"ID":"1d5ac742-0517-40a4-b33f-d3f22a25770d","Type":"ContainerStarted","Data":"5b749636defed442ac9d0ec68c147c4b48ebf00a51b44569aebda088bd488403"}
Jul 21 13:26:59.648912 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:26:59.648853    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" podStartSLOduration=1.648838289 podStartE2EDuration="1.648838289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:26:59.646216005 +0000 UTC m=+2139.621781857" watchObservedRunningTime="2026-07-21 13:26:59.648838289 +0000 UTC m=+2139.624404130"
Jul 21 13:27:02.046237 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:02.046199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:27:09.086855 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:09.086811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:27:09.087237 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:09.086878    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:27:09.099318 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:09.099286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:27:09.682837 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:09.682806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:27:13.528729 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:13.528639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:27:18.699482 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.699445    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:27:18.703460 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.703443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.708539 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.708518    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba2d34\"/\"openshift-service-ca.crt\""
Jul 21 13:27:18.708687 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.708588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba2d34\"/\"default-dockercfg-jdghx\""
Jul 21 13:27:18.708687 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.708575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba2d34\"/\"test-model-ba2d34-kserve-self-signed-certs\""
Jul 21 13:27:18.709816 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.709799    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba2d34\"/\"kube-root-ca.crt\""
Jul 21 13:27:18.722418 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.722391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:27:18.821230 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.821398 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.821398 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.821398 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.821504 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpsh7\" (UniqueName: \"kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.821539 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.821512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.922939 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.922897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923137 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.922977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpsh7\" (UniqueName: \"kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923137 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923137 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923137 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923137 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923513 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923629 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.923629 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.923547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.925277 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.925255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.925710 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.925691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:18.931143 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:18.931120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpsh7\" (UniqueName: \"kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7\") pod \"test-model-ba2d34-kserve-59747ffff7-rxwq6\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") " pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:19.013507 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:19.013408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:19.154017 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:19.153987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:27:19.155722 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:27:19.155694    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee93ac65_4163_4be5_abcd_3c2bd62d8c90.slice/crio-7f84c6fc878171ce7bf65f9afc10949b09988dbe021addfed55421e1902e7aa7 WatchSource:0}: Error finding container 7f84c6fc878171ce7bf65f9afc10949b09988dbe021addfed55421e1902e7aa7: Status 404 returned error can't find the container with id 7f84c6fc878171ce7bf65f9afc10949b09988dbe021addfed55421e1902e7aa7
Jul 21 13:27:19.722711 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:19.722670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" event={"ID":"ee93ac65-4163-4be5-abcd-3c2bd62d8c90","Type":"ContainerStarted","Data":"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"}
Jul 21 13:27:19.722711 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:19.722716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" event={"ID":"ee93ac65-4163-4be5-abcd-3c2bd62d8c90","Type":"ContainerStarted","Data":"7f84c6fc878171ce7bf65f9afc10949b09988dbe021addfed55421e1902e7aa7"}
Jul 21 13:27:19.744671 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:19.744617    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" podStartSLOduration=1.744601174 podStartE2EDuration="1.744601174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:27:19.743885023 +0000 UTC m=+2159.719450865" watchObservedRunningTime="2026-07-21 13:27:19.744601174 +0000 UTC m=+2159.720167013"
Jul 21 13:27:24.437257 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:24.437221    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:27:29.014018 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:29.013981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:29.014018 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:29.014025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:29.026280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:29.026254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:27:29.781532 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:27:29.781497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:28:12.184730 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:12.184697    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:28:13.084970 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:13.084932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:28:19.621034 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:19.620995    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:28:27.204770 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.204700    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" podUID="1d5ac742-0517-40a4-b33f-d3f22a25770d" containerName="main" containerID="cri-o://acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e" gracePeriod=45
Jul 21 13:28:27.455295 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.455236    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:28:27.490339 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490309    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h97h7\" (UniqueName: \"kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490482 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490370    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490482 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490482 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490466    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490641 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490511    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490641 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm\") pod \"1d5ac742-0517-40a4-b33f-d3f22a25770d\" (UID: \"1d5ac742-0517-40a4-b33f-d3f22a25770d\") "
Jul 21 13:28:27.490756 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490631    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home" (OuterVolumeSpecName: "home") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:27.490756 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:27.490904 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:27.490985 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490960    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:27.491041 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.490982    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:27.492687 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.492659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm" (OuterVolumeSpecName: "dshm") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:27.492794 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.492725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7" (OuterVolumeSpecName: "kube-api-access-h97h7") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "kube-api-access-h97h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:28:27.492835 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.492788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d5ac742-0517-40a4-b33f-d3f22a25770d" (UID: "1d5ac742-0517-40a4-b33f-d3f22a25770d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:28:27.592200 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.592167    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:27.592200 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.592195    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d5ac742-0517-40a4-b33f-d3f22a25770d-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:27.592200 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.592205    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h97h7\" (UniqueName: \"kubernetes.io/projected/1d5ac742-0517-40a4-b33f-d3f22a25770d-kube-api-access-h97h7\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:27.592430 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:27.592213    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d5ac742-0517-40a4-b33f-d3f22a25770d-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.067327 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.067291    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d5ac742-0517-40a4-b33f-d3f22a25770d" containerID="acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e" exitCode=0
Jul 21 13:28:28.067507 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.067339    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"
Jul 21 13:28:28.067507 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.067380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" event={"ID":"1d5ac742-0517-40a4-b33f-d3f22a25770d","Type":"ContainerDied","Data":"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"}
Jul 21 13:28:28.067507 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.067428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk" event={"ID":"1d5ac742-0517-40a4-b33f-d3f22a25770d","Type":"ContainerDied","Data":"5b749636defed442ac9d0ec68c147c4b48ebf00a51b44569aebda088bd488403"}
Jul 21 13:28:28.067507 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.067450    2560 scope.go:117] "RemoveContainer" containerID="acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"
Jul 21 13:28:28.078279 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.078259    2560 scope.go:117] "RemoveContainer" containerID="acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"
Jul 21 13:28:28.078694 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:28:28.078664    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e\": container with ID starting with acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e not found: ID does not exist" containerID="acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"
Jul 21 13:28:28.078786 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.078706    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e"} err="failed to get container status \"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e\": rpc error: code = NotFound desc = could not find container \"acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e\": container with ID starting with acd440d15dfd1c4ac5df4f14b857ec6318988679b403bd6e513b1de600fc4e5e not found: ID does not exist"
Jul 21 13:28:28.092484 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.092449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:28:28.102839 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.102809    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d1dafe/test-model-d1dafe-kserve-6d857c4787-f29nk"]
Jul 21 13:28:28.110453 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.110424    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" podUID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" containerName="main" containerID="cri-o://39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8" gracePeriod=45
Jul 21 13:28:28.359625 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.359600    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:28:28.406141 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.406367 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406341    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpsh7\" (UniqueName: \"kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.406637 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406614    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home" (OuterVolumeSpecName: "home") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:28.406727 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.406786 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406754    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.407002 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.406982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.407108 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407094    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs\") pod \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\" (UID: \"ee93ac65-4163-4be5-abcd-3c2bd62d8c90\") "
Jul 21 13:28:28.407345 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407017    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:28.407345 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:28.407633 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407608    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.407714 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407639    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.407714 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.407654    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.409294 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.409272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:28:28.409383 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.409290    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm" (OuterVolumeSpecName: "dshm") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:28.409424 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.409381    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7" (OuterVolumeSpecName: "kube-api-access-vpsh7") pod "ee93ac65-4163-4be5-abcd-3c2bd62d8c90" (UID: "ee93ac65-4163-4be5-abcd-3c2bd62d8c90"). InnerVolumeSpecName "kube-api-access-vpsh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:28:28.508286 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.508246    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.508286 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.508276    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.508286 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.508288    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpsh7\" (UniqueName: \"kubernetes.io/projected/ee93ac65-4163-4be5-abcd-3c2bd62d8c90-kube-api-access-vpsh7\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:28:28.742930 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:28.742893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:28:29.074565 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.074475    2560 generic.go:356] "Generic (PLEG): container finished" podID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" containerID="39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8" exitCode=0
Jul 21 13:28:29.074565 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.074530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" event={"ID":"ee93ac65-4163-4be5-abcd-3c2bd62d8c90","Type":"ContainerDied","Data":"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"}
Jul 21 13:28:29.074565 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.074557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6" event={"ID":"ee93ac65-4163-4be5-abcd-3c2bd62d8c90","Type":"ContainerDied","Data":"7f84c6fc878171ce7bf65f9afc10949b09988dbe021addfed55421e1902e7aa7"}
Jul 21 13:28:29.074845 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.074593    2560 scope.go:117] "RemoveContainer" containerID="39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"
Jul 21 13:28:29.074845 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.074533    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"
Jul 21 13:28:29.083883 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.083864    2560 scope.go:117] "RemoveContainer" containerID="39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"
Jul 21 13:28:29.084148 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:28:29.084126    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8\": container with ID starting with 39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8 not found: ID does not exist" containerID="39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"
Jul 21 13:28:29.084214 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.084158    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8"} err="failed to get container status \"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8\": rpc error: code = NotFound desc = could not find container \"39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8\": container with ID starting with 39b9ab6064ef2752709c2aabb28856cd41440d036a0b5a9e58519bca78a06cd8 not found: ID does not exist"
Jul 21 13:28:29.098694 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.098667    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:28:29.104621 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.104591    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ba2d34/test-model-ba2d34-kserve-59747ffff7-rxwq6"]
Jul 21 13:28:29.331573 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.331498    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5ac742-0517-40a4-b33f-d3f22a25770d" path="/var/lib/kubelet/pods/1d5ac742-0517-40a4-b33f-d3f22a25770d/volumes"
Jul 21 13:28:29.331933 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:29.331918    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" path="/var/lib/kubelet/pods/ee93ac65-4163-4be5-abcd-3c2bd62d8c90/volumes"
Jul 21 13:28:48.731984 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:28:48.731901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:29:08.842714 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:29:08.842675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:29:26.933047 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:29:26.933002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:29:42.625316 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:29:42.625279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:30:09.538210 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:09.538165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:30:27.633707 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:27.633628    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:30:42.537835 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:42.537797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:30:52.023306 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023276    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:30:52.023716 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5ac742-0517-40a4-b33f-d3f22a25770d" containerName="main"
Jul 21 13:30:52.023760 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023717    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5ac742-0517-40a4-b33f-d3f22a25770d" containerName="main"
Jul 21 13:30:52.023760 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023727    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" containerName="main"
Jul 21 13:30:52.023760 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023733    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" containerName="main"
Jul 21 13:30:52.023852 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023809    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee93ac65-4163-4be5-abcd-3c2bd62d8c90" containerName="main"
Jul 21 13:30:52.023852 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.023817    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5ac742-0517-40a4-b33f-d3f22a25770d" containerName="main"
Jul 21 13:30:52.027032 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.027014    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.030818 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.030780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"kube-root-ca.crt\""
Jul 21 13:30:52.030818 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.030800    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"auth-test-model-3af280-kserve-self-signed-certs\""
Jul 21 13:30:52.030818 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.030812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"default-dockercfg-p44q2\""
Jul 21 13:30:52.031064 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.030807    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"openshift-service-ca.crt\""
Jul 21 13:30:52.041193 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.041169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:30:52.106977 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.106939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.106977 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.106983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.107182 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.107018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.107182 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.107046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.107182 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.107076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.107182 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.107122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m77b\" (UniqueName: \"kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.207950 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.207910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.207956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.207987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m77b\" (UniqueName: \"kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208371 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208410 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.208482 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.208454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.210412 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.210391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.210561 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.210546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.217611 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.217572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m77b\" (UniqueName: \"kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b\") pod \"auth-test-model-3af280-kserve-6794d869c5-2zwpk\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") " pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.336621 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.336526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:30:52.482218 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.482187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:30:52.763635 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.763573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" event={"ID":"e49533bb-4312-4c34-a90b-c97362ece649","Type":"ContainerStarted","Data":"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"}
Jul 21 13:30:52.763635 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.763642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" event={"ID":"e49533bb-4312-4c34-a90b-c97362ece649","Type":"ContainerStarted","Data":"a91f0d20e5f5070a4336ba21d735e1f946be4b737d183256e824a55f823cedba"}
Jul 21 13:30:52.784385 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:52.784333    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" podStartSLOduration=0.784317054 podStartE2EDuration="784.317054ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:30:52.783001471 +0000 UTC m=+2372.758567313" watchObservedRunningTime="2026-07-21 13:30:52.784317054 +0000 UTC m=+2372.759882895"
Jul 21 13:30:55.728010 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:30:55.727967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:31:02.337028 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:02.336981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:31:02.337426 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:02.337042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:31:02.349972 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:02.349948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:31:02.822329 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:02.822297    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:31:15.346111 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.346079    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:31:15.349915 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.349895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.354271 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.354216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"openshift-service-ca.crt\""
Jul 21 13:31:15.355253 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.355220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"kube-root-ca.crt\""
Jul 21 13:31:15.355253 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.355246    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"auth-test-model-2df168-kserve-self-signed-certs\""
Jul 21 13:31:15.355428 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.355306    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"default-dockercfg-ldrx5\""
Jul 21 13:31:15.362097 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.362076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:31:15.440493 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.440746 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.440746 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.440746 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.440746 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.440746 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.440722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541366 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541366 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541627 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541627 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541751 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541751 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541864 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.541983 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.542056 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.541983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.543870 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.543841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.543978 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.543954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.550645 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.550620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd\") pod \"auth-test-model-2df168-kserve-79c847b999-7j29t\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") " pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.661200 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.661166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:15.797987 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.797957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:31:15.799797 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:31:15.799769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc908462_3a88_448a_84e1_71a337eed71e.slice/crio-abb88eb00433eb69ab53bbae7978c5bff9dd657b0aa9e1e289ee700d6b8e97c5 WatchSource:0}: Error finding container abb88eb00433eb69ab53bbae7978c5bff9dd657b0aa9e1e289ee700d6b8e97c5: Status 404 returned error can't find the container with id abb88eb00433eb69ab53bbae7978c5bff9dd657b0aa9e1e289ee700d6b8e97c5
Jul 21 13:31:15.879930 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.879893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" event={"ID":"cc908462-3a88-448a-84e1-71a337eed71e","Type":"ContainerStarted","Data":"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"}
Jul 21 13:31:15.879930 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.879938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" event={"ID":"cc908462-3a88-448a-84e1-71a337eed71e","Type":"ContainerStarted","Data":"abb88eb00433eb69ab53bbae7978c5bff9dd657b0aa9e1e289ee700d6b8e97c5"}
Jul 21 13:31:15.903922 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:15.903871    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" podStartSLOduration=0.903853476 podStartE2EDuration="903.853476ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:31:15.901693209 +0000 UTC m=+2395.877259064" watchObservedRunningTime="2026-07-21 13:31:15.903853476 +0000 UTC m=+2395.879419318"
Jul 21 13:31:18.925024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:18.924988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:31:25.661552 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:25.661509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:25.662073 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:25.661574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:25.673976 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:25.673945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:25.937648 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:25.937550    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:31:37.231294 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:37.231254    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:31:55.221935 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:31:55.221896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:32:12.419758 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:32:12.419721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:32:30.133791 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:32:30.133748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:32:45.128847 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:32:45.128810    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:33:01.875235 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:01.875194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:33:19.143833 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:19.143744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:33:23.991622 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:23.991566    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:33:24.916018 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:24.915984    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:33:29.943270 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:29.943230    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:33:29.946788 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:29.946770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:29.950067 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:29.950046    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"sub-test-model-3af280-kserve-self-signed-certs\""
Jul 21 13:33:29.963065 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:29.963041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:33:30.057890 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.057854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.057890 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.057893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.058138 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.057925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.058138 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.058038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.058138 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.058081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.058293 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.058172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlb4\" (UniqueName: \"kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159086 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159287 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159287 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159287 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlb4\" (UniqueName: \"kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159472 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159472 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159669 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159732 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.159770 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.159712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.161474 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.161456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.161794 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.161774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.168549 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.168524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlb4\" (UniqueName: \"kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4\") pod \"sub-test-model-3af280-kserve-f75d8c867-rtfg8\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") " pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.256744 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.256653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:30.394918 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.394892    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:33:30.397120 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:33:30.397097    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fffaa7e_890f_435d_bafe_84d8c17e194b.slice/crio-7b039f68a5f1a00510fb5afea8c3d64dc04849c97576c0ae16b2b131aa694a31 WatchSource:0}: Error finding container 7b039f68a5f1a00510fb5afea8c3d64dc04849c97576c0ae16b2b131aa694a31: Status 404 returned error can't find the container with id 7b039f68a5f1a00510fb5afea8c3d64dc04849c97576c0ae16b2b131aa694a31
Jul 21 13:33:30.544191 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.544107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" event={"ID":"2fffaa7e-890f-435d-bafe-84d8c17e194b","Type":"ContainerStarted","Data":"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"}
Jul 21 13:33:30.544191 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.544149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" event={"ID":"2fffaa7e-890f-435d-bafe-84d8c17e194b","Type":"ContainerStarted","Data":"7b039f68a5f1a00510fb5afea8c3d64dc04849c97576c0ae16b2b131aa694a31"}
Jul 21 13:33:30.566778 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:30.566733    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" podStartSLOduration=1.566717476 podStartE2EDuration="1.566717476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:33:30.564503006 +0000 UTC m=+2530.540068850" watchObservedRunningTime="2026-07-21 13:33:30.566717476 +0000 UTC m=+2530.542283317"
Jul 21 13:33:37.730074 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:37.730034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:33:39.012049 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.011991    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" podUID="e49533bb-4312-4c34-a90b-c97362ece649" containerName="main" containerID="cri-o://b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665" gracePeriod=45
Jul 21 13:33:39.257370 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.257340    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:33:39.346751 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346666    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m77b\" (UniqueName: \"kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.346751 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.346960 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.346960 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.346960 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.346960 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.346860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs\") pod \"e49533bb-4312-4c34-a90b-c97362ece649\" (UID: \"e49533bb-4312-4c34-a90b-c97362ece649\") "
Jul 21 13:33:39.347168 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:39.347168 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home" (OuterVolumeSpecName: "home") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:39.347168 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347126    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache" (OuterVolumeSpecName: "model-cache") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:39.347313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347206    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.347313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347223    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.347313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.347233    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.349092 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.349060    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b" (OuterVolumeSpecName: "kube-api-access-6m77b") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "kube-api-access-6m77b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:33:39.349210 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.349114    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm" (OuterVolumeSpecName: "dshm") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:39.349210 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.349123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e49533bb-4312-4c34-a90b-c97362ece649" (UID: "e49533bb-4312-4c34-a90b-c97362ece649"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:33:39.448054 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.448020    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m77b\" (UniqueName: \"kubernetes.io/projected/e49533bb-4312-4c34-a90b-c97362ece649-kube-api-access-6m77b\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.448054 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.448053    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e49533bb-4312-4c34-a90b-c97362ece649-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.448248 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.448065    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e49533bb-4312-4c34-a90b-c97362ece649-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:39.588769 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.588736    2560 generic.go:356] "Generic (PLEG): container finished" podID="e49533bb-4312-4c34-a90b-c97362ece649" containerID="b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665" exitCode=0
Jul 21 13:33:39.588949 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.588775    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"
Jul 21 13:33:39.588949 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.588818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" event={"ID":"e49533bb-4312-4c34-a90b-c97362ece649","Type":"ContainerDied","Data":"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"}
Jul 21 13:33:39.588949 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.588859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk" event={"ID":"e49533bb-4312-4c34-a90b-c97362ece649","Type":"ContainerDied","Data":"a91f0d20e5f5070a4336ba21d735e1f946be4b737d183256e824a55f823cedba"}
Jul 21 13:33:39.588949 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.588877    2560 scope.go:117] "RemoveContainer" containerID="b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"
Jul 21 13:33:39.597994 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.597972    2560 scope.go:117] "RemoveContainer" containerID="b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"
Jul 21 13:33:39.598224 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:33:39.598202    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665\": container with ID starting with b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665 not found: ID does not exist" containerID="b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"
Jul 21 13:33:39.598274 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.598236    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665"} err="failed to get container status \"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665\": rpc error: code = NotFound desc = could not find container \"b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665\": container with ID starting with b4441b2d7f8c83605c9fab864b6e8777b567296574aaaa33b9460d12b3964665 not found: ID does not exist"
Jul 21 13:33:39.611315 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.611295    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:33:39.614911 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.614892    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/auth-test-model-3af280-kserve-6794d869c5-2zwpk"]
Jul 21 13:33:39.936391 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:39.936329    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" podUID="cc908462-3a88-448a-84e1-71a337eed71e" containerName="main" containerID="cri-o://49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf" gracePeriod=45
Jul 21 13:33:40.200393 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.200335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:33:40.256817 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.256781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:40.256962 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.256837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:40.268603 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.268572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:40.357333 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357492 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357492 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357420    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357492 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357449    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357492 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357739 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm\") pod \"cc908462-3a88-448a-84e1-71a337eed71e\" (UID: \"cc908462-3a88-448a-84e1-71a337eed71e\") "
Jul 21 13:33:40.357739 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:40.357841 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357747    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home" (OuterVolumeSpecName: "home") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:40.357841 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:40.357971 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357954    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.358024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357976    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.358024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.357992    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.359644 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.359623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:33:40.360065 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.360038    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm" (OuterVolumeSpecName: "dshm") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:33:40.360065 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.360059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd" (OuterVolumeSpecName: "kube-api-access-nmmjd") pod "cc908462-3a88-448a-84e1-71a337eed71e" (UID: "cc908462-3a88-448a-84e1-71a337eed71e"). InnerVolumeSpecName "kube-api-access-nmmjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:33:40.458917 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.458846    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc908462-3a88-448a-84e1-71a337eed71e-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.458917 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.458870    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/cc908462-3a88-448a-84e1-71a337eed71e-kube-api-access-nmmjd\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.458917 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.458880    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc908462-3a88-448a-84e1-71a337eed71e-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:33:40.597140 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.597099    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc908462-3a88-448a-84e1-71a337eed71e" containerID="49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf" exitCode=0
Jul 21 13:33:40.597313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.597146    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"
Jul 21 13:33:40.597313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.597183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" event={"ID":"cc908462-3a88-448a-84e1-71a337eed71e","Type":"ContainerDied","Data":"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"}
Jul 21 13:33:40.597313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.597221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t" event={"ID":"cc908462-3a88-448a-84e1-71a337eed71e","Type":"ContainerDied","Data":"abb88eb00433eb69ab53bbae7978c5bff9dd657b0aa9e1e289ee700d6b8e97c5"}
Jul 21 13:33:40.597313 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.597239    2560 scope.go:117] "RemoveContainer" containerID="49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"
Jul 21 13:33:40.607011 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.606996    2560 scope.go:117] "RemoveContainer" containerID="49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"
Jul 21 13:33:40.607253 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:33:40.607237    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf\": container with ID starting with 49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf not found: ID does not exist" containerID="49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"
Jul 21 13:33:40.607316 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.607261    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf"} err="failed to get container status \"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf\": rpc error: code = NotFound desc = could not find container \"49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf\": container with ID starting with 49385a8ffb2bed9ba9168eec148e23b5e2beb24cb0d558fbb22cd83c7605abbf not found: ID does not exist"
Jul 21 13:33:40.609195 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.609173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:33:40.621929 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.621905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:33:40.628722 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:40.628701    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/auth-test-model-2df168-kserve-79c847b999-7j29t"]
Jul 21 13:33:41.331136 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:41.331103    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc908462-3a88-448a-84e1-71a337eed71e" path="/var/lib/kubelet/pods/cc908462-3a88-448a-84e1-71a337eed71e/volumes"
Jul 21 13:33:41.331532 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:41.331518    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49533bb-4312-4c34-a90b-c97362ece649" path="/var/lib/kubelet/pods/e49533bb-4312-4c34-a90b-c97362ece649/volumes"
Jul 21 13:33:53.720549 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.720513    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:33:53.721031 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.720966    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc908462-3a88-448a-84e1-71a337eed71e" containerName="main"
Jul 21 13:33:53.721031 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.720980    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc908462-3a88-448a-84e1-71a337eed71e" containerName="main"
Jul 21 13:33:53.721031 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.721009    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49533bb-4312-4c34-a90b-c97362ece649" containerName="main"
Jul 21 13:33:53.721031 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.721015    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49533bb-4312-4c34-a90b-c97362ece649" containerName="main"
Jul 21 13:33:53.721280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.721095    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49533bb-4312-4c34-a90b-c97362ece649" containerName="main"
Jul 21 13:33:53.721280 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.721104    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc908462-3a88-448a-84e1-71a337eed71e" containerName="main"
Jul 21 13:33:53.725638 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.725617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.729599 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.729560    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"openshift-service-ca.crt\""
Jul 21 13:33:53.729712 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.729568    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"default-dockercfg-ldrx5\""
Jul 21 13:33:53.729712 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.729567    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"sub-test-model-2df168-kserve-self-signed-certs\""
Jul 21 13:33:53.729832 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.729604    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"kube-root-ca.crt\""
Jul 21 13:33:53.735307 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.735284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:33:53.777569 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.777694 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.777694 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl2s6\" (UniqueName: \"kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.777770 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.777770 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.777834 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.777806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.878376 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.878502 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.878502 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.878502 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl2s6\" (UniqueName: \"kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.879026 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.879026 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.879026 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.879026 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.879026 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.878936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.881105 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.881083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.881197 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.881125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:53.888167 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:53.888147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl2s6\" (UniqueName: \"kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6\") pod \"sub-test-model-2df168-kserve-56484c4577-276zc\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") " pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:54.036135 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:54.036064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:33:54.171413 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:54.171388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:33:54.173994 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:33:54.173962    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd78b9be_6fde_4f6a_a151_2d5da1639979.slice/crio-7dbeafd5b8cd692e085a86fa050eeea69c09bfb71cd49664a7528c4c453eb0c5 WatchSource:0}: Error finding container 7dbeafd5b8cd692e085a86fa050eeea69c09bfb71cd49664a7528c4c453eb0c5: Status 404 returned error can't find the container with id 7dbeafd5b8cd692e085a86fa050eeea69c09bfb71cd49664a7528c4c453eb0c5
Jul 21 13:33:54.670670 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:54.670634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" event={"ID":"dd78b9be-6fde-4f6a-a151-2d5da1639979","Type":"ContainerStarted","Data":"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"}
Jul 21 13:33:54.670833 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:54.670681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" event={"ID":"dd78b9be-6fde-4f6a-a151-2d5da1639979","Type":"ContainerStarted","Data":"7dbeafd5b8cd692e085a86fa050eeea69c09bfb71cd49664a7528c4c453eb0c5"}
Jul 21 13:33:54.691413 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:54.691366    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" podStartSLOduration=1.691350821 podStartE2EDuration="1.691350821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:33:54.689102058 +0000 UTC m=+2554.664667924" watchObservedRunningTime="2026-07-21 13:33:54.691350821 +0000 UTC m=+2554.666916680"
Jul 21 13:33:57.336609 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:33:57.334312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:34:04.036894 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:04.036845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:04.037344 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:04.037113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:04.049416 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:04.049393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:04.731491 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:04.731459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:11.741597 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:11.741544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:34:30.002059 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:30.002027    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:34:31.367760 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:31.367727    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:34:33.730242 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:33.730209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:34:45.022066 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.021971    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" podUID="2fffaa7e-890f-435d-bafe-84d8c17e194b" containerName="main" containerID="cri-o://7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd" gracePeriod=45
Jul 21 13:34:45.275390 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.275329    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:34:45.356330 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356297    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356330 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356333    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twlb4\" (UniqueName: \"kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356530 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356530 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356530 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356530 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356469    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm\") pod \"2fffaa7e-890f-435d-bafe-84d8c17e194b\" (UID: \"2fffaa7e-890f-435d-bafe-84d8c17e194b\") "
Jul 21 13:34:45.356764 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:45.356764 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356649    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:45.356764 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356745    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home" (OuterVolumeSpecName: "home") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:45.356921 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356821    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.356921 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356837    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.356921 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.356866    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.358591 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.358550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm" (OuterVolumeSpecName: "dshm") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:45.358711 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.358605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4" (OuterVolumeSpecName: "kube-api-access-twlb4") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "kube-api-access-twlb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:34:45.358711 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.358624    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fffaa7e-890f-435d-bafe-84d8c17e194b" (UID: "2fffaa7e-890f-435d-bafe-84d8c17e194b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:34:45.457841 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.457807    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fffaa7e-890f-435d-bafe-84d8c17e194b-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.457841 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.457838    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twlb4\" (UniqueName: \"kubernetes.io/projected/2fffaa7e-890f-435d-bafe-84d8c17e194b-kube-api-access-twlb4\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.457841 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.457850    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fffaa7e-890f-435d-bafe-84d8c17e194b-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:45.614980 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.614901    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:34:45.615308 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.615296    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fffaa7e-890f-435d-bafe-84d8c17e194b" containerName="main"
Jul 21 13:34:45.615350 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.615310    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fffaa7e-890f-435d-bafe-84d8c17e194b" containerName="main"
Jul 21 13:34:45.615394 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.615385    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fffaa7e-890f-435d-bafe-84d8c17e194b" containerName="main"
Jul 21 13:34:45.618547 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.618529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.621172 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.621154    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af280\"/\"rate-test-model-3af280-kserve-self-signed-certs\""
Jul 21 13:34:45.634058 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.634028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:34:45.659418 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.659554 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.659554 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.659554 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.659744 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvm8\" (UniqueName: \"kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.659744 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.659684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760621 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760822 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760822 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760822 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760822 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvm8\" (UniqueName: \"kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.760822 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.760795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.761200 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.761171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.761279 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.761234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.761336 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.761293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.762980 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.762955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.763148 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.763129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.769400 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.769381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvm8\" (UniqueName: \"kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8\") pod \"rate-test-model-3af280-kserve-7b8ff5595f-g5pcj\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") " pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.927651 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.927619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:45.928834 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.928799    2560 generic.go:356] "Generic (PLEG): container finished" podID="2fffaa7e-890f-435d-bafe-84d8c17e194b" containerID="7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd" exitCode=0
Jul 21 13:34:45.928963 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.928840    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"
Jul 21 13:34:45.928963 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.928854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" event={"ID":"2fffaa7e-890f-435d-bafe-84d8c17e194b","Type":"ContainerDied","Data":"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"}
Jul 21 13:34:45.928963 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.928887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8" event={"ID":"2fffaa7e-890f-435d-bafe-84d8c17e194b","Type":"ContainerDied","Data":"7b039f68a5f1a00510fb5afea8c3d64dc04849c97576c0ae16b2b131aa694a31"}
Jul 21 13:34:45.928963 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.928903    2560 scope.go:117] "RemoveContainer" containerID="7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"
Jul 21 13:34:45.940456 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.940436    2560 scope.go:117] "RemoveContainer" containerID="7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"
Jul 21 13:34:45.940751 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:34:45.940731    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd\": container with ID starting with 7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd not found: ID does not exist" containerID="7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"
Jul 21 13:34:45.940820 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.940760    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd"} err="failed to get container status \"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd\": rpc error: code = NotFound desc = could not find container \"7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd\": container with ID starting with 7bcbae0e8c1744cb563208aac5857cb97269b240d05fad7b99fd902a220c19bd not found: ID does not exist"
Jul 21 13:34:45.955231 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.955199    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:34:45.961203 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:45.961164    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/sub-test-model-3af280-kserve-f75d8c867-rtfg8"]
Jul 21 13:34:46.068984 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.068957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:34:46.071094 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:34:46.071068    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c12fb03_cfb8_44fa_9028_d4ce9818e760.slice/crio-cf060fde13a3d7de272f41f3a0e8426180d8ac162415b83ad05969ce207389df WatchSource:0}: Error finding container cf060fde13a3d7de272f41f3a0e8426180d8ac162415b83ad05969ce207389df: Status 404 returned error can't find the container with id cf060fde13a3d7de272f41f3a0e8426180d8ac162415b83ad05969ce207389df
Jul 21 13:34:46.387642 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.387535    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" podUID="dd78b9be-6fde-4f6a-a151-2d5da1639979" containerName="main" containerID="cri-o://e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f" gracePeriod=45
Jul 21 13:34:46.645216 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.645191    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:46.769609 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769546    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.769779 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl2s6\" (UniqueName: \"kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.769779 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769676    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.769779 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.769779 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.770005 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:46.770005 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.769803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home\") pod \"dd78b9be-6fde-4f6a-a151-2d5da1639979\" (UID: \"dd78b9be-6fde-4f6a-a151-2d5da1639979\") "
Jul 21 13:34:46.770112 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.770051    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home" (OuterVolumeSpecName: "home") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:46.770112 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.770062    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:46.770259 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.770238    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.770297 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.770265    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.770297 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.770277    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.771944 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.771922    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6" (OuterVolumeSpecName: "kube-api-access-zl2s6") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "kube-api-access-zl2s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:34:46.772019 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.771947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:34:46.772019 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.771949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm" (OuterVolumeSpecName: "dshm") pod "dd78b9be-6fde-4f6a-a151-2d5da1639979" (UID: "dd78b9be-6fde-4f6a-a151-2d5da1639979"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:34:46.871225 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.871188    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl2s6\" (UniqueName: \"kubernetes.io/projected/dd78b9be-6fde-4f6a-a151-2d5da1639979-kube-api-access-zl2s6\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.871225 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.871220    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd78b9be-6fde-4f6a-a151-2d5da1639979-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.871225 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.871229    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd78b9be-6fde-4f6a-a151-2d5da1639979-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:34:46.937686 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.937572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" event={"ID":"7c12fb03-cfb8-44fa-9028-d4ce9818e760","Type":"ContainerStarted","Data":"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"}
Jul 21 13:34:46.937686 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.937642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" event={"ID":"7c12fb03-cfb8-44fa-9028-d4ce9818e760","Type":"ContainerStarted","Data":"cf060fde13a3d7de272f41f3a0e8426180d8ac162415b83ad05969ce207389df"}
Jul 21 13:34:46.939943 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.939918    2560 generic.go:356] "Generic (PLEG): container finished" podID="dd78b9be-6fde-4f6a-a151-2d5da1639979" containerID="e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f" exitCode=0
Jul 21 13:34:46.940076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.939953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"
Jul 21 13:34:46.940076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.939967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" event={"ID":"dd78b9be-6fde-4f6a-a151-2d5da1639979","Type":"ContainerDied","Data":"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"}
Jul 21 13:34:46.940076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.939992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc" event={"ID":"dd78b9be-6fde-4f6a-a151-2d5da1639979","Type":"ContainerDied","Data":"7dbeafd5b8cd692e085a86fa050eeea69c09bfb71cd49664a7528c4c453eb0c5"}
Jul 21 13:34:46.940076 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.940009    2560 scope.go:117] "RemoveContainer" containerID="e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"
Jul 21 13:34:46.948538 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.948517    2560 scope.go:117] "RemoveContainer" containerID="e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"
Jul 21 13:34:46.948790 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:34:46.948773    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f\": container with ID starting with e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f not found: ID does not exist" containerID="e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"
Jul 21 13:34:46.948844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.948797    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f"} err="failed to get container status \"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f\": rpc error: code = NotFound desc = could not find container \"e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f\": container with ID starting with e1344c97088c37174f27d15cce568ada0897aac9073c192b349a7cfffb983d5f not found: ID does not exist"
Jul 21 13:34:46.958806 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.958765    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" podStartSLOduration=1.958751512 podStartE2EDuration="1.958751512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:34:46.956378032 +0000 UTC m=+2606.931943874" watchObservedRunningTime="2026-07-21 13:34:46.958751512 +0000 UTC m=+2606.934317354"
Jul 21 13:34:46.970538 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.970503    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:34:46.977882 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:46.977860    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/sub-test-model-2df168-kserve-56484c4577-276zc"]
Jul 21 13:34:47.336860 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:47.336780    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fffaa7e-890f-435d-bafe-84d8c17e194b" path="/var/lib/kubelet/pods/2fffaa7e-890f-435d-bafe-84d8c17e194b/volumes"
Jul 21 13:34:47.337382 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:47.337362    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd78b9be-6fde-4f6a-a151-2d5da1639979" path="/var/lib/kubelet/pods/dd78b9be-6fde-4f6a-a151-2d5da1639979/volumes"
Jul 21 13:34:47.837512 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:47.837477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:34:55.928158 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:55.928125    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:55.928563 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:55.928170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:55.940344 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:55.940322    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:34:55.995189 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:34:55.995162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:35:18.533000 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.532969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:35:18.533443 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.533375    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd78b9be-6fde-4f6a-a151-2d5da1639979" containerName="main"
Jul 21 13:35:18.533443 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.533387    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd78b9be-6fde-4f6a-a151-2d5da1639979" containerName="main"
Jul 21 13:35:18.533519 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.533463    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd78b9be-6fde-4f6a-a151-2d5da1639979" containerName="main"
Jul 21 13:35:18.536136 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.536116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.539970 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.539948    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"openshift-service-ca.crt\""
Jul 21 13:35:18.540085 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.540035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"kube-root-ca.crt\""
Jul 21 13:35:18.540085 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.540055    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"default-dockercfg-ldrx5\""
Jul 21 13:35:18.540205 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.540107    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2df168\"/\"rate-test-model-2df168-kserve-self-signed-certs\""
Jul 21 13:35:18.548889 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.548868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:35:18.571596 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m6bf\" (UniqueName: \"kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.571725 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.571725 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.571725 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.571844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.571844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.571793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673174 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673327 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673327 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673441 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m6bf\" (UniqueName: \"kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673500 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673500 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673620 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673620 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.673754 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.673737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.675514 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.675495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.675865 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.675845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.682750 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.682727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m6bf\" (UniqueName: \"kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf\") pod \"rate-test-model-2df168-kserve-c9596bdff-jnhs8\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") " pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.845768 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.845699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:18.990168 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:18.990144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:35:18.992818 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:35:18.992785    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aaa023b_09ce_4de6_bd35_97b1d65636b4.slice/crio-da0ab36b788e1e153ca388fcc0a6430444a0137a3ad9adec3b0151f347f710bc WatchSource:0}: Error finding container da0ab36b788e1e153ca388fcc0a6430444a0137a3ad9adec3b0151f347f710bc: Status 404 returned error can't find the container with id da0ab36b788e1e153ca388fcc0a6430444a0137a3ad9adec3b0151f347f710bc
Jul 21 13:35:19.100344 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:19.100251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" event={"ID":"4aaa023b-09ce-4de6-bd35-97b1d65636b4","Type":"ContainerStarted","Data":"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"}
Jul 21 13:35:19.100344 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:19.100295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" event={"ID":"4aaa023b-09ce-4de6-bd35-97b1d65636b4","Type":"ContainerStarted","Data":"da0ab36b788e1e153ca388fcc0a6430444a0137a3ad9adec3b0151f347f710bc"}
Jul 21 13:35:19.133882 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:19.133829    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" podStartSLOduration=1.133814095 podStartE2EDuration="1.133814095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:35:19.130636882 +0000 UTC m=+2639.106202724" watchObservedRunningTime="2026-07-21 13:35:19.133814095 +0000 UTC m=+2639.109379939"
Jul 21 13:35:21.127657 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:21.127622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:35:28.846136 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:28.846094    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:28.846667 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:28.846158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:28.858749 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:28.858725    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:29.159347 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:29.159318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:35:51.836547 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:35:51.836511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:36:06.334568 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:06.334532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:36:13.025524 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:13.025449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:36:14.011183 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:14.011151    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:36:26.345032 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:26.345000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:36:28.045161 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.045111    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" podUID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" containerName="main" containerID="cri-o://c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a" gracePeriod=45
Jul 21 13:36:28.296916 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.296852    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:36:28.391492 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391468    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391641 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdvm8\" (UniqueName: \"kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391641 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391641 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391609    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391761 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391805 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391762    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs\") pod \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\" (UID: \"7c12fb03-cfb8-44fa-9028-d4ce9818e760\") "
Jul 21 13:36:28.391913 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home" (OuterVolumeSpecName: "home") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:28.392002 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:28.392002 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.391926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:28.392118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.392088    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:28.392118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.392101    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:28.392118 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.392114    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:28.393633 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.393553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm" (OuterVolumeSpecName: "dshm") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:28.393796 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.393772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8" (OuterVolumeSpecName: "kube-api-access-bdvm8") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "kube-api-access-bdvm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:28.393900 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.393831    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c12fb03-cfb8-44fa-9028-d4ce9818e760" (UID: "7c12fb03-cfb8-44fa-9028-d4ce9818e760"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:36:28.450972 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.450948    2560 generic.go:356] "Generic (PLEG): container finished" podID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" containerID="c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a" exitCode=0
Jul 21 13:36:28.451069 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.450988    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"
Jul 21 13:36:28.451069 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.451008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" event={"ID":"7c12fb03-cfb8-44fa-9028-d4ce9818e760","Type":"ContainerDied","Data":"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"}
Jul 21 13:36:28.451069 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.451035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj" event={"ID":"7c12fb03-cfb8-44fa-9028-d4ce9818e760","Type":"ContainerDied","Data":"cf060fde13a3d7de272f41f3a0e8426180d8ac162415b83ad05969ce207389df"}
Jul 21 13:36:28.451069 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.451052    2560 scope.go:117] "RemoveContainer" containerID="c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"
Jul 21 13:36:28.460109 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.460095    2560 scope.go:117] "RemoveContainer" containerID="c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"
Jul 21 13:36:28.460340 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:36:28.460324    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a\": container with ID starting with c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a not found: ID does not exist" containerID="c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"
Jul 21 13:36:28.460386 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.460347    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a"} err="failed to get container status \"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a\": rpc error: code = NotFound desc = could not find container \"c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a\": container with ID starting with c42fea44c242c6c3fec635d4fae29573f771bc8be4a2733908ffeec8fa4c0f1a not found: ID does not exist"
Jul 21 13:36:28.473217 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.473190    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:36:28.477222 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.477200    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af280/rate-test-model-3af280-kserve-7b8ff5595f-g5pcj"]
Jul 21 13:36:28.492817 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.492796    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c12fb03-cfb8-44fa-9028-d4ce9818e760-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:28.492817 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.492816    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c12fb03-cfb8-44fa-9028-d4ce9818e760-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:28.492942 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:28.492827    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdvm8\" (UniqueName: \"kubernetes.io/projected/7c12fb03-cfb8-44fa-9028-d4ce9818e760-kube-api-access-bdvm8\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.031128 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.031058    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerName="main" containerID="cri-o://e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39" gracePeriod=45
Jul 21 13:36:29.149166 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.149128    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": dial tcp 10.134.0.42:8000: connect: connection refused"
Jul 21 13:36:29.286158 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.286096    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:36:29.331338 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.331312    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" path="/var/lib/kubelet/pods/7c12fb03-cfb8-44fa-9028-d4ce9818e760/volumes"
Jul 21 13:36:29.400781 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.400923 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.400923 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400818    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.400923 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m6bf\" (UniqueName: \"kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.401058 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400938    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.401058 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.400983    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs\") pod \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\" (UID: \"4aaa023b-09ce-4de6-bd35-97b1d65636b4\") "
Jul 21 13:36:29.401058 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home" (OuterVolumeSpecName: "home") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:29.401172 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401052    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:29.401172 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401120    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:29.401291 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401271    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-model-cache\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.401336 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401298    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-home\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.401373 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.401336    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tmp-dir\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.403121 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.403095    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm" (OuterVolumeSpecName: "dshm") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:36:29.403244 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.403126    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:36:29.403244 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.403154    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf" (OuterVolumeSpecName: "kube-api-access-7m6bf") pod "4aaa023b-09ce-4de6-bd35-97b1d65636b4" (UID: "4aaa023b-09ce-4de6-bd35-97b1d65636b4"). InnerVolumeSpecName "kube-api-access-7m6bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:29.456868 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.456841    2560 generic.go:356] "Generic (PLEG): container finished" podID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerID="e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39" exitCode=0
Jul 21 13:36:29.456970 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.456884    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"
Jul 21 13:36:29.456970 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.456931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" event={"ID":"4aaa023b-09ce-4de6-bd35-97b1d65636b4","Type":"ContainerDied","Data":"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"}
Jul 21 13:36:29.457093 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.456976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8" event={"ID":"4aaa023b-09ce-4de6-bd35-97b1d65636b4","Type":"ContainerDied","Data":"da0ab36b788e1e153ca388fcc0a6430444a0137a3ad9adec3b0151f347f710bc"}
Jul 21 13:36:29.457093 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.456993    2560 scope.go:117] "RemoveContainer" containerID="e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"
Jul 21 13:36:29.465716 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.465701    2560 scope.go:117] "RemoveContainer" containerID="e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"
Jul 21 13:36:29.465952 ip-10-0-130-81 kubenswrapper[2560]: E0721 13:36:29.465934    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39\": container with ID starting with e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39 not found: ID does not exist" containerID="e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"
Jul 21 13:36:29.466010 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.465959    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39"} err="failed to get container status \"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39\": rpc error: code = NotFound desc = could not find container \"e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39\": container with ID starting with e65b768364eba4a891456e8cd0a30e7c3a5a7cb351726cbc21fa97d19f304f39 not found: ID does not exist"
Jul 21 13:36:29.484880 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.484859    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:36:29.486561 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.486542    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2df168/rate-test-model-2df168-kserve-c9596bdff-jnhs8"]
Jul 21 13:36:29.502572 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.502550    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m6bf\" (UniqueName: \"kubernetes.io/projected/4aaa023b-09ce-4de6-bd35-97b1d65636b4-kube-api-access-7m6bf\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.502572 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.502574    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aaa023b-09ce-4de6-bd35-97b1d65636b4-dshm\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.502703 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:29.502604    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aaa023b-09ce-4de6-bd35-97b1d65636b4-tls-certs\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jul 21 13:36:31.331758 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:31.331728    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" path="/var/lib/kubelet/pods/4aaa023b-09ce-4de6-bd35-97b1d65636b4/volumes"
Jul 21 13:36:46.527787 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:36:46.527748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:37:08.418664 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:08.418629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cctk8"]
Jul 21 13:37:23.764219 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:23.764191    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-xvrlh_516099c3-cf75-4deb-9f6e-3c576dba2364/copy-manifests/0.log"
Jul 21 13:37:23.771106 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:23.771070    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-xvrlh_516099c3-cf75-4deb-9f6e-3c576dba2364/manager/0.log"
Jul 21 13:37:25.978924 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:25.978895    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lzpfg_36f24332-7ef8-4a7e-9a64-25c2d51ed9b5/manager/0.log"
Jul 21 13:37:26.091837 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:26.091816    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q55gt_99fdc815-495a-487b-b5ea-f28cab20e37c/kuadrant-console-plugin/0.log"
Jul 21 13:37:26.443205 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:26.443176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cctk8_f882d997-62c5-439d-8c31-35f5b45b6ef3/limitador/0.log"
Jul 21 13:37:27.121388 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:27.121360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-c5lq8_c9d045d1-9f0e-44d5-b105-1e58e404ab54/kube-auth-proxy/0.log"
Jul 21 13:37:28.236316 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:28.236281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-s5x6q_d2ade13d-a8f1-4e8d-9ed6-aff32fdbba6a/main/0.log"
Jul 21 13:37:28.345658 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:28.345628    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrrpk_e5ba79c9-97eb-48bb-9427-1c9d5580f8cc/main/0.log"
Jul 21 13:37:28.565624 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:28.565545    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lmzhj_7588f29c-fc31-4a26-a150-7c3080a419ad/main/0.log"
Jul 21 13:37:37.520117 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:37.520083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jtd47_8f7c55e6-847f-440a-a059-661b9d2037ef/global-pull-secret-syncer/0.log"
Jul 21 13:37:37.706096 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:37.706061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rl4kn_312e9065-5985-422b-ae14-79239a357c71/konnectivity-agent/0.log"
Jul 21 13:37:37.783119 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:37.783009    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-81.ec2.internal_6ed4dca545bf09c8bd4721b6d663bce9/haproxy/0.log"
Jul 21 13:37:42.939430 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:42.939312    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lzpfg_36f24332-7ef8-4a7e-9a64-25c2d51ed9b5/manager/0.log"
Jul 21 13:37:42.971727 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:42.971703    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q55gt_99fdc815-495a-487b-b5ea-f28cab20e37c/kuadrant-console-plugin/0.log"
Jul 21 13:37:43.312698 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:43.312599    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cctk8_f882d997-62c5-439d-8c31-35f5b45b6ef3/limitador/0.log"
Jul 21 13:37:45.100639 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.100613    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/alertmanager/0.log"
Jul 21 13:37:45.136735 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.136714    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/config-reloader/0.log"
Jul 21 13:37:45.170241 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.170216    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/kube-rbac-proxy-web/0.log"
Jul 21 13:37:45.209545 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.209484    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/kube-rbac-proxy/0.log"
Jul 21 13:37:45.240154 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.240132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/kube-rbac-proxy-metric/0.log"
Jul 21 13:37:45.269916 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.269898    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/prom-label-proxy/0.log"
Jul 21 13:37:45.306700 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.306653    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_abe924a8-5055-42d2-9203-d8aac1881595/init-config-reloader/0.log"
Jul 21 13:37:45.440146 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.440121    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-tkgl6_7cff7821-dfe6-49fe-b9a9-9de825ec6a9e/kube-state-metrics/0.log"
Jul 21 13:37:45.510237 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.510173    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-tkgl6_7cff7821-dfe6-49fe-b9a9-9de825ec6a9e/kube-rbac-proxy-main/0.log"
Jul 21 13:37:45.574065 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.574046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-tkgl6_7cff7821-dfe6-49fe-b9a9-9de825ec6a9e/kube-rbac-proxy-self/0.log"
Jul 21 13:37:45.628391 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.628371    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67c7699699-lhczq_3bd10245-828a-4242-b37d-b39ace7a023d/metrics-server/0.log"
Jul 21 13:37:45.665551 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.665532    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-crkgs_25efdf9c-b664-4b52-a613-d8418282cd7b/monitoring-plugin/0.log"
Jul 21 13:37:45.801805 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.801711    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcsmc_561024e5-b532-4812-aa86-741c66f217b2/node-exporter/0.log"
Jul 21 13:37:45.838104 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.838080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcsmc_561024e5-b532-4812-aa86-741c66f217b2/kube-rbac-proxy/0.log"
Jul 21 13:37:45.866281 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:45.866258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcsmc_561024e5-b532-4812-aa86-741c66f217b2/init-textfile/0.log"
Jul 21 13:37:46.002797 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.002770    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-m4r4r_057222e5-6d89-41b2-9e8f-e09f11416815/kube-rbac-proxy-main/0.log"
Jul 21 13:37:46.036483 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.036462    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-m4r4r_057222e5-6d89-41b2-9e8f-e09f11416815/kube-rbac-proxy-self/0.log"
Jul 21 13:37:46.067711 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.067658    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-m4r4r_057222e5-6d89-41b2-9e8f-e09f11416815/openshift-state-metrics/0.log"
Jul 21 13:37:46.105647 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.105628    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/prometheus/0.log"
Jul 21 13:37:46.132479 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.132456    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/config-reloader/0.log"
Jul 21 13:37:46.158235 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.158211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/thanos-sidecar/0.log"
Jul 21 13:37:46.187901 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.187885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/kube-rbac-proxy-web/0.log"
Jul 21 13:37:46.212231 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.212215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/kube-rbac-proxy/0.log"
Jul 21 13:37:46.240289 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.240272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/kube-rbac-proxy-thanos/0.log"
Jul 21 13:37:46.266682 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.266666    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51e33b47-4564-4a58-bba0-a4e31650df8d/init-config-reloader/0.log"
Jul 21 13:37:46.298130 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.298109    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qtmz7_ddd39b07-167e-4921-bebc-230b43636741/prometheus-operator/0.log"
Jul 21 13:37:46.321398 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.321344    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qtmz7_ddd39b07-167e-4921-bebc-230b43636741/kube-rbac-proxy/0.log"
Jul 21 13:37:46.351792 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.351770    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-8crnr_5392a2c4-8acb-4f1c-928f-a1e2a80d3696/prometheus-operator-admission-webhook/0.log"
Jul 21 13:37:46.384635 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.384616    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d59d4755b-w5t2b_cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc/telemeter-client/0.log"
Jul 21 13:37:46.413796 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.413776    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d59d4755b-w5t2b_cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc/reload/0.log"
Jul 21 13:37:46.442893 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.442859    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d59d4755b-w5t2b_cbeb7fa0-fb8d-470e-b2e9-4c105cf6bccc/kube-rbac-proxy/0.log"
Jul 21 13:37:46.473656 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.473638    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/thanos-query/0.log"
Jul 21 13:37:46.496016 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.495995    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/kube-rbac-proxy-web/0.log"
Jul 21 13:37:46.523529 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.523509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/kube-rbac-proxy/0.log"
Jul 21 13:37:46.552297 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.552279    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/prom-label-proxy/0.log"
Jul 21 13:37:46.577982 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.577931    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/kube-rbac-proxy-rules/0.log"
Jul 21 13:37:46.600878 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:46.600859    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78954f84b9-tddfl_bf82a627-8ff4-4c65-adbe-e2f248d29624/kube-rbac-proxy-metrics/0.log"
Jul 21 13:37:47.739324 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.739286    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"]
Jul 21 13:37:47.739909 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.739888    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerName="main"
Jul 21 13:37:47.739998 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.739911    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerName="main"
Jul 21 13:37:47.739998 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.739940    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" containerName="main"
Jul 21 13:37:47.739998 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.739949    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" containerName="main"
Jul 21 13:37:47.740154 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.740055    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aaa023b-09ce-4de6-bd35-97b1d65636b4" containerName="main"
Jul 21 13:37:47.740154 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.740073    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c12fb03-cfb8-44fa-9028-d4ce9818e760" containerName="main"
Jul 21 13:37:47.743431 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.743408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.747210 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.747173    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m5mj\"/\"kube-root-ca.crt\""
Jul 21 13:37:47.748184 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.748166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4m5mj\"/\"default-dockercfg-565cz\""
Jul 21 13:37:47.748281 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.748185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m5mj\"/\"openshift-service-ca.crt\""
Jul 21 13:37:47.771905 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.771882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"]
Jul 21 13:37:47.780345 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.780317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjnx\" (UniqueName: \"kubernetes.io/projected/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-kube-api-access-vzjnx\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.780445 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.780369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-lib-modules\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.780445 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.780402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-proc\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.780563 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.780543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-sys\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.780659 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.780642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-podres\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881670 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjnx\" (UniqueName: \"kubernetes.io/projected/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-kube-api-access-vzjnx\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-lib-modules\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-proc\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-sys\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-podres\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.881844 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-lib-modules\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.882024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-proc\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.882024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-sys\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.882024 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.881942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-podres\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:47.892135 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:47.892112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjnx\" (UniqueName: \"kubernetes.io/projected/bc32aaae-9af1-4121-be3d-7a81fd8d3f20-kube-api-access-vzjnx\") pod \"perf-node-gather-daemonset-g9mk9\" (UID: \"bc32aaae-9af1-4121-be3d-7a81fd8d3f20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:48.053545 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.053450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:48.200809 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.200775    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"]
Jul 21 13:37:48.208144 ip-10-0-130-81 kubenswrapper[2560]: W0721 13:37:48.208114    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc32aaae_9af1_4121_be3d_7a81fd8d3f20.slice/crio-95f1c82778acd6d21823bc9da82aaf92d232d9a6854210ad125a24d42180a027 WatchSource:0}: Error finding container 95f1c82778acd6d21823bc9da82aaf92d232d9a6854210ad125a24d42180a027: Status 404 returned error can't find the container with id 95f1c82778acd6d21823bc9da82aaf92d232d9a6854210ad125a24d42180a027
Jul 21 13:37:48.852878 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.852845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9" event={"ID":"bc32aaae-9af1-4121-be3d-7a81fd8d3f20","Type":"ContainerStarted","Data":"072b36f7dee9f9c0f694d4fd3286fa521fae42e35b015d682f4ebda1c08cfe8e"}
Jul 21 13:37:48.853259 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.852895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9" event={"ID":"bc32aaae-9af1-4121-be3d-7a81fd8d3f20","Type":"ContainerStarted","Data":"95f1c82778acd6d21823bc9da82aaf92d232d9a6854210ad125a24d42180a027"}
Jul 21 13:37:48.853259 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.852956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:48.877509 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:48.877460    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9" podStartSLOduration=1.877445692 podStartE2EDuration="1.877445692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 13:37:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:37:48.875896388 +0000 UTC m=+2788.851462232" watchObservedRunningTime="2026-07-21 13:37:48.877445692 +0000 UTC m=+2788.853011533"
Jul 21 13:37:49.024088 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:49.024061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d96796dd7-4r8t5_56024df1-08b3-446c-84c8-ca29dd2dfc3f/console/0.log"
Jul 21 13:37:50.994978 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:50.994943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crxg7_566e349e-4089-44d5-ab3c-aa5a61c21a65/dns/0.log"
Jul 21 13:37:51.038749 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:51.038721    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crxg7_566e349e-4089-44d5-ab3c-aa5a61c21a65/kube-rbac-proxy/0.log"
Jul 21 13:37:51.218380 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:51.218355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff9mt_20990eec-f798-477f-9385-306a27bbe21e/dns-node-resolver/0.log"
Jul 21 13:37:52.015660 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:52.015627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m5ldv_298db261-e45a-42bf-9d24-d73a2e23b6dc/node-ca/0.log"
Jul 21 13:37:53.429719 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:53.429694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-c5lq8_c9d045d1-9f0e-44d5-b105-1e58e404ab54/kube-auth-proxy/0.log"
Jul 21 13:37:54.522950 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:54.522917    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvwng_016c740f-06d3-47f0-bdd7-2dd7dab09c74/serve-healthcheck-canary/0.log"
Jul 21 13:37:54.868060 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:54.867989    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-g9mk9"
Jul 21 13:37:55.357646 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:55.357617    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46rhv_ddbf40d8-570d-4a80-a478-c3f3ceb951dc/kube-rbac-proxy/0.log"
Jul 21 13:37:55.388287 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:55.388261    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46rhv_ddbf40d8-570d-4a80-a478-c3f3ceb951dc/exporter/0.log"
Jul 21 13:37:55.433062 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:55.433041    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46rhv_ddbf40d8-570d-4a80-a478-c3f3ceb951dc/extractor/0.log"
Jul 21 13:37:58.195513 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:58.195486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-c5lq8_c9d045d1-9f0e-44d5-b105-1e58e404ab54/kube-auth-proxy/0.log"
Jul 21 13:37:59.228756 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:59.228659    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-xvrlh_516099c3-cf75-4deb-9f6e-3c576dba2364/manager/0.log"
Jul 21 13:37:59.266057 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:59.266038    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-xvrlh_516099c3-cf75-4deb-9f6e-3c576dba2364/copy-manifests/0.log"
Jul 21 13:37:59.817742 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:37:59.817705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-c5lq8_c9d045d1-9f0e-44d5-b105-1e58e404ab54/kube-auth-proxy/0.log"
Jul 21 13:38:00.508502 ip-10-0-130-81 kubenswrapper[2560]: I0721 13:38:00.508469    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54f95887b7-8scmq_bc533b6e-82d1-44fe-87fd-39b3bed4fad7/manager/0.log"