Jul 13 21:22:10.455154 ip-10-0-136-49 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.888890    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893933    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893947    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893953    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893956    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893960    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893970    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893975    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.000805 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893979    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:10.977923 ip-10-0-136-49 systemd[1]: Started Kubernetes Kubelet.
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893985    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893989    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893994    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.893999    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894003    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894008    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894013    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894017    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894022    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894026    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894030    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894034    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894038    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894042    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894046    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894051    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894055    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894060    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894063    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.002422 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894068    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894073    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894078    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894082    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894088    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894092    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894097    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894101    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894105    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894110    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894114    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894118    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894122    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894126    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894130    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894134    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894138    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894144    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894151    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.003323 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894155    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894159    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894165    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894169    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894173    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894177    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894181    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894186    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894190    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894194    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894198    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894202    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894206    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894210    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894214    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894219    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894222    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894227    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894231    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894237    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.005986 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894241    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894245    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894249    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894255    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894261    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894267    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894272    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894276    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894280    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894284    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894288    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894293    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894297    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894301    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894305    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894309    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894313    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894317    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894321    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894325    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.007037 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894329    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894333    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894338    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894341    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894346    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894349    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894356    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894361    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894365    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894369    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894373    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894378    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.894385    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895515    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895525    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895532    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895536    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895541    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895546    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.008410 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895551    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895555    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895559    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895564    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895569    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895576    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895580    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895585    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895589    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895593    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895597    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895601    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895605    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895609    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895613    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895617    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895621    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895625    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895630    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.009516 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895634    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895638    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895642    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895646    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895650    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895654    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895659    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895664    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895668    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895672    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895676    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895680    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895684    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895689    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895693    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895699    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895704    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895709    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895715    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.010807 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895720    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895726    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895731    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895736    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895740    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895744    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895749    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895753    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895757    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895761    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895765    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895769    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895775    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895780    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895784    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895788    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895792    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895796    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895800    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895804    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.011667 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895809    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895813    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895817    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895822    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895827    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895831    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895835    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895839    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895843    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895847    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895851    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895855    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895878    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895883    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895887    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895891    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895896    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895900    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895904    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895908    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.012463 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895913    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895917    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895921    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895925    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895929    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895933    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895937    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895953    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895956    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895961    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895966    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895970    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895977    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895982    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.895986    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896539    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896545    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896549    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896554    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896559    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.192748 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896563    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896567    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896571    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896574    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896578    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896583    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896590    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896595    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896600    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896606    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896610    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896614    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896618    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896623    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896627    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896631    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896635    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896639    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896643    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.207385 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896647    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896652    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896656    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896660    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896664    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896671    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896676    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896680    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896684    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896688    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896691    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896696    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896699    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896703    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896707    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896711    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896715    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896719    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896723    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896727    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.208201 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896732    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896735    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896740    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896745    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896749    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896753    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896757    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896761    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896765    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896769    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896773    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896776    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896780    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896785    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896791    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896795    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896799    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896805    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896810    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.209069 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896817    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896821    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896826    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896831    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896836    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896840    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896845    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896849    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896853    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896857    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896879    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896883    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896887    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896891    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896896    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896900    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896903    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896907    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896911    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896916    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.209713 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896920    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896924    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896928    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896932    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896935    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896940    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896943    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896947    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896951    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896955    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896963    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896967    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896970    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896976    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896980    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.896985    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897089    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897099    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897108    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897114    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897120    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 21:22:11.210698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897126    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897133    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897173    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897181    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897185    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897190    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897195    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897199    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897203    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897206    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897210    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897213    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897217    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897224    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897227    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897230    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897234    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897237    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897243    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897246    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897250    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897254    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897257    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897261    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 21:22:11.211392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897264    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897267    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897271    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897276    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897279    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897282    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897286    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897289    2565 flags.go:64] FLAG: --enable-server="true"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897293    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897297    2565 flags.go:64] FLAG: --event-burst="100"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897301    2565 flags.go:64] FLAG: --event-qps="50"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897305    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897309    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897312    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897323    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897326    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897330    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897333    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897336    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897339    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897342    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897346    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897349    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897352    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897355    2565 flags.go:64] FLAG: --feature-gates=""
Jul 13 21:22:11.212418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897359    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897362    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897366    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897369    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897373    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897376    2565 flags.go:64] FLAG: --help="false"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897380    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897383    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897387    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897390    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897395    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897398    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897402    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897405    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897408    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897411    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897415    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897418    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897422    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897425    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897429    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897432    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897435    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897438    2565 flags.go:64] FLAG: --lock-file=""
Jul 13 21:22:11.213219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897441    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897444    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897447    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897453    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897457    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897460    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897463    2565 flags.go:64] FLAG: --logging-format="text"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897466    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897470    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897473    2565 flags.go:64] FLAG: --manifest-url=""
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897477    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897483    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897487    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897491    2565 flags.go:64] FLAG: --max-pods="110"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897494    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897498    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897501    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897504    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897508    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897511    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897514    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897523    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897526    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897530    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 21:22:11.214121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897533    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897537    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897544    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897547    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897551    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897554    2565 flags.go:64] FLAG: --port="10250"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897558    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897561    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-092e3922947d8d245"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897564    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897567    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897571    2565 flags.go:64] FLAG: --register-node="true"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897574    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897578    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897581    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897584    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897586    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897591    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897594    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897600    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897604    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897607    2565 flags.go:64] FLAG: --runonce="false"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897610    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897614    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897617    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897620    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 21:22:11.214849 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897623    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897627    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897630    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897633    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897636    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897639    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897642    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897645    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897648    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897652    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897654    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897661    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897666    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897669    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897676    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897679    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897682    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897685    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897689    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897692    2565 flags.go:64] FLAG: --v="2"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897696    2565 flags.go:64] FLAG: --version="false"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897700    2565 flags.go:64] FLAG: --vmodule=""
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897704    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.897707    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 21:22:11.215781 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897860    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897870    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897874    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897877    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897880    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897884    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897887    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897890    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897895    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897899    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897903    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897906    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897909    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897912    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897915    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897918    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897921    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897924    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897927    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.216544 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897930    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897933    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897936    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897943    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897947    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897951    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897956    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897960    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897965    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897968    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897971    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897973    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897976    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897979    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897983    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897986    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897989    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897992    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897995    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.431342 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.897997    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898000    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898003    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898006    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898009    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898012    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898015    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898017    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898020    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898023    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898026    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898028    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898031    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898034    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898037    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898040    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898045    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898048    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898051    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898054    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898056    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.432484 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898059    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898062    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898065    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898068    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898071    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898073    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898078    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898080    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898083    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898086    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898089    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898091    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898094    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898097    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898099    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898102    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898105    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898108    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898110    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898113    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.435490 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898116    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898119    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898122    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898124    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898128    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898130    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898133    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898137    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898140    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898143    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898146    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898148    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898151    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898154    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898157    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898162    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898165    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898169    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898174    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.436441 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.898179    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.899043    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.909696    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.909717    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.910587    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.910596    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910664    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910669    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910673    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910677    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910681    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910684    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910687    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910690    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910693    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.438377 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910696    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910698    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910702    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910704    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910707    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910711    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910714    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910723    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910726    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910729    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910732    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910734    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910737    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910740    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910743    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910746    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910749    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910751    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910754    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910757    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.438903 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910760    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910763    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910765    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910769    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910771    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910775    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910777    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910780    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910783    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910786    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910788    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910791    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910794    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910796    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910799    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910802    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910805    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910808    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910811    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.439687 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910817    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910822    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910825    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910828    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910831    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910834    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910837    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910839    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910842    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910845    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910847    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910850    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910853    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910856    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910874    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910878    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910881    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910884    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910887    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910890    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.440351 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910892    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910895    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910898    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910901    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910905    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910909    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910913    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910916    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910919    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910922    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910925    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910929    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910935    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910938    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910941    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910944    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910947    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910950    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910953    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.441254 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910956    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910958    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910961    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910964    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910967    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910969    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910972    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910975    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910978    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910981    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910984    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.910988    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.910994    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911121    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911127    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:22:11.441839 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911130    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911133    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911136    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911139    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911142    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911145    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911147    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911150    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911153    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911155    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911160    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911164    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911167    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911170    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911172    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911175    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911178    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911181    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911186    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:22:11.442691 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911189    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911193    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911195    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911198    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911201    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911203    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911206    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911209    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911212    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911215    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911217    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911220    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911225    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911228    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911231    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911234    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911238    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911240    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911243    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:22:11.443345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911246    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911249    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911251    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911256    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911261    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911264    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911267    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911270    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911273    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911276    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911278    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911281    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911284    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911286    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911293    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911307    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911311    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911314    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911317    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:22:11.444000 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911319    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911322    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911325    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911328    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911330    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911333    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911336    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911339    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911341    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911344    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911347    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911350    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911352    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911355    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911357    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911361    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911366    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911370    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911373    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911376    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:22:11.619638 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911379    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911382    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911384    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911387    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911390    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911394    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911398    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911401    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911404    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911407    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911410    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911413    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911417    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911420    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911423    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911425    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911429    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:22:11.621744 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:10.911431    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.911437    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.911573    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.915519    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.916893    2565 server.go:1019] "Starting client certificate rotation"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.917009    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.917040    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.920555    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.926598    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.940582    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.943507    2565 log.go:25] "Validated CRI v1 image API"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.944487    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 21:22:11.622679 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.949136    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bc9c4acf-ce4c-456d-b216-edbb9f55e450:/dev/nvme0n1p3 f8757a39-0a69-4aee-bf76-5e68f56a780e:/dev/nvme0n1p4]
Jul 13 21:22:11.624337 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.949154    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.956989    2565 manager.go:216] Machine: {Timestamp:2026-07-13 21:22:10.954969039 +0000 UTC m=+0.379918074 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100201 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cc684d13070a831da7234c7e8ed55 SystemUUID:ec2cc684-d130-70a8-31da-7234c7e8ed55 BootID:d5626d89-b08a-4a21-b9da-05af6d674c3f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:bb:67:6a:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:bb:67:6a:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:00:45:e2:51:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.957118    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.957215    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.958505    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.960381    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.960419    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 21:22:11.624567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.961213    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.961224    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.961232    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.961872    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.962734    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.965913    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966410    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966489    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966517    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966540    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966557    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.966580    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.967188    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.967213    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.970219    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.971879    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.971910    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972564    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972579    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972585    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972591    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972599    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972605    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972690    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972696    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972703    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972708    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972718    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.972725    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.973498    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.973505    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.976982    2565 server.go:1268] "Started kubelet"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.977088    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.977105    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.977184    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.978644    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.980055    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.980639    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.980663    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.980780    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 21:22:11.626629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.985614    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.985631    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.985703    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.985031    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-49.ec2.internal.18c1f64b5e16bb09  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-49.ec2.internal,UID:ip-10-0-136-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-49.ec2.internal,},FirstTimestamp:2026-07-13 21:22:10.976955145 +0000 UTC m=+0.401904180,LastTimestamp:2026-07-13 21:22:10.976955145 +0000 UTC m=+0.401904180,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-49.ec2.internal,}"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.986417    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.986425    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.986439    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.986546    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.986566    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988324    2565 factory.go:55] Registering systemd factory
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988344    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988628    2565 factory.go:153] Registering CRI-O factory
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988648    2565 factory.go:223] Registration of the crio container factory successfully
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988710    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988738    2565 factory.go:103] Registering Raw factory
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.988756    2565 manager.go:1196] Started watching for new ooms in manager
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.989111    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.989723    2565 manager.go:349] Starting recovery of all containers
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.990950    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:10.991054    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:10.994988    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6qvr"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.004032    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6qvr"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.006419    2565 manager.go:354] Recovery completed
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.007830    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.011306    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.013476    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.013503    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.013515    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014078    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014089    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014107    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:22:11.628525 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014106    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014841    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014888    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.014899    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.015226    2565 policy_none.go:49] "None policy: Start"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.015243    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.015272    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.015307    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-49.ec2.internal.18c1f64b60442b7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-49.ec2.internal,UID:ip-10-0-136-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-49.ec2.internal,},FirstTimestamp:2026-07-13 21:22:11.013487485 +0000 UTC m=+0.438436521,LastTimestamp:2026-07-13 21:22:11.013487485 +0000 UTC m=+0.438436521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-49.ec2.internal,}"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.016351    2565 policy_none.go:47] "Start"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.063475    2565 manager.go:337] "Starting Device Plugin manager"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.063514    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.063528    2565 server.go:87] "Starting device plugin registration server"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.063829    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.063844    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.063936    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.064035    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.064043    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.064592    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.064636    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.161664    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.163039    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.163079    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.163111    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.163147    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.163980    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.164783    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.164818    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.164833    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.164889    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.165467    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.171087    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.171107    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-49.ec2.internal\": node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.817996 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.187170    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.263258    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"]
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.263371    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.264469    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.264504    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.264517    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.265745    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.265891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.265923    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266521    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266525    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266549    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266555    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266560    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.266566    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.268324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.268537    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.269426    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.269450    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.269460    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.287977    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.288329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af6932374b5d843067eb5a100f1bbb82-config\") pod \"kube-apiserver-proxy-ip-10-0-136-49.ec2.internal\" (UID: \"af6932374b5d843067eb5a100f1bbb82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.288372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.288400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.293489    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-49.ec2.internal\" not found" node="ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.297994    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-49.ec2.internal\" not found" node="ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.819072 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.388939    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.388993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af6932374b5d843067eb5a100f1bbb82-config\") pod \"kube-apiserver-proxy-ip-10-0-136-49.ec2.internal\" (UID: \"af6932374b5d843067eb5a100f1bbb82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.389000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af6932374b5d843067eb5a100f1bbb82-config\") pod \"kube-apiserver-proxy-ip-10-0-136-49.ec2.internal\" (UID: \"af6932374b5d843067eb5a100f1bbb82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.389031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.389054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.389054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.389082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b77399a04a40a30518adb675dba5f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal\" (UID: \"50b77399a04a40a30518adb675dba5f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.490121    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.593474    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.596889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.601373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.693905    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.820538 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.794554    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.930486 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.894826    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:11.930486 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.915979    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 21:22:11.930486 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:11.916173    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 21:22:11.995566 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:11.995516    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:12.008527 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.008482    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 21:17:11 +0000 UTC" deadline="2028-03-16 16:52:19.095273742 +0000 UTC"
Jul 13 21:22:12.008527 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.008521    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14683h30m7.086755694s"
Jul 13 21:22:12.096620 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.096583    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:12.178345 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:12.178291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6932374b5d843067eb5a100f1bbb82.slice/crio-2b9e3560e0b2dab58b424bfbbfd03f084636b190f291f7a172246230849e7b57 WatchSource:0}: Error finding container 2b9e3560e0b2dab58b424bfbbfd03f084636b190f291f7a172246230849e7b57: Status 404 returned error can't find the container with id 2b9e3560e0b2dab58b424bfbbfd03f084636b190f291f7a172246230849e7b57
Jul 13 21:22:12.178633 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:12.178607    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b77399a04a40a30518adb675dba5f5.slice/crio-5b4cab8e73d836c7d148ffa7663ea187e0f0ba7bff6a54b7bffd95e64b4b9688 WatchSource:0}: Error finding container 5b4cab8e73d836c7d148ffa7663ea187e0f0ba7bff6a54b7bffd95e64b4b9688: Status 404 returned error can't find the container with id 5b4cab8e73d836c7d148ffa7663ea187e0f0ba7bff6a54b7bffd95e64b4b9688
Jul 13 21:22:12.184380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.184356    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:22:12.197433 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.197408    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:12.276073 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.276039    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:22:12.297822 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.297768    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-49.ec2.internal\" not found"
Jul 13 21:22:12.347021 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.346999    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:22:12.387578 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.387529    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:12.400005 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.399981    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:22:12.401137 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.401123    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal"
Jul 13 21:22:12.409772 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.409733    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:22:12.419692 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.419666    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:22:12.969170 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.969135    2565 apiserver.go:52] "Watching apiserver"
Jul 13 21:22:12.975738 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.975714    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 21:22:12.976290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.976243    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zx5cr","openshift-network-diagnostics/network-check-target-srvr6","openshift-ovn-kubernetes/ovnkube-node-2bdzr","kube-system/global-pull-secret-syncer-wq8dc","kube-system/konnectivity-agent-8kzp5","kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal","openshift-dns/node-resolver-gvp4g","openshift-image-registry/node-ca-mclf9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal","openshift-multus/multus-additional-cni-plugins-txrx5","openshift-network-operator/iptables-alerter-n2bcz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5","openshift-cluster-node-tuning-operator/tuned-jnjjb","openshift-multus/multus-cd7sl"]
Jul 13 21:22:12.978236 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.978178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:12.978369 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.978274    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:12.979934 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.979899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:12.981409 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.981380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:12.981517 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.981453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:12.982429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.982403    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p2drv\""
Jul 13 21:22:12.982429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.982420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.982592 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.982429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.982906 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.982878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:12.984749 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.984726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:12.985274 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.985222    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.985534 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.985496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 21:22:12.985612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.985533    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.986635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.985933    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 21:22:12.986635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.986246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 21:22:12.986635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.986307    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 21:22:12.986635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.986246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 21:22:12.986635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.986454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dmk62\""
Jul 13 21:22:12.986972 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.986764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:12.986972 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:12.986879    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:12.987716 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.987695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:12.987809 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.987747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kc6n4\""
Jul 13 21:22:12.987809 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.987777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 21:22:12.988045 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.988025    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 21:22:12.990012 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.989553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:12.990345 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.990322    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.990441 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.990333    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 21:22:12.990441 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.990353    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.990441 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.990423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zqmlc\""
Jul 13 21:22:12.991417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.991395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:12.992656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.992637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 21:22:12.992795 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.992777    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 21:22:12.992917 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.992902    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.993005 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.992990    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.993054 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.993038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 21:22:12.994635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.994320    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:12.994635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.994589    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4k7nl\""
Jul 13 21:22:12.994635 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.994635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 21:22:12.996343 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.995558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.996343 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.996219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7qwxx\""
Jul 13 21:22:12.998005 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.996507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.998005 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.996776    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.998171 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.998131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:12.999094 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.998321    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.999094 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.998592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 21:22:12.999094 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:12.998644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pwlld\""
Jul 13 21:22:13.000378 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.000677 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-kubelet\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.000677 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.000677 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-config\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c011349c-0d8c-4311-86c1-cbc3fe77fe10-agent-certs\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68s75\" (UniqueName: \"kubernetes.io/projected/46d5a4f3-3b75-4241-808f-9768284406bf-kube-api-access-68s75\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-kubelet-config\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-systemd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67bc7979-d12b-43db-87d5-c52b0936c85f-hosts-file\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxws\" (UniqueName: \"kubernetes.io/projected/67bc7979-d12b-43db-87d5-c52b0936c85f-kube-api-access-rkxws\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:13.000910 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-netns\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-etc-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-slash\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-var-lib-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.000998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-node-log\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qd9\" (UniqueName: \"kubernetes.io/projected/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-kube-api-access-s2qd9\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-bin\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-netd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-env-overrides\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovn-node-metrics-cert\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001136    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c011349c-0d8c-4311-86c1-cbc3fe77fe10-konnectivity-ca\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001186    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d87qc\""
Jul 13 21:22:13.001314 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001403    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bc7979-d12b-43db-87d5-c52b0936c85f-tmp-dir\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-dbus\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-ovn\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-log-socket\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-script-lib\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740767ae-217d-4f15-b44f-86a3a32756c7-serviceca\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-systemd-units\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740767ae-217d-4f15-b44f-86a3a32756c7-host\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrbq9\" (UniqueName: \"kubernetes.io/projected/740767ae-217d-4f15-b44f-86a3a32756c7-kube-api-access-vrbq9\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.002157 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.001753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.003171 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.003137    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 21:22:13.003819 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.003804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xvhtb\""
Jul 13 21:22:13.021644 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.020487    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-smhnp"
Jul 13 21:22:13.028053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.028025    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-smhnp"
Jul 13 21:22:13.087434 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.087404    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 21:22:13.101989 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.101950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-script-lib\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-systemd-units\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740767ae-217d-4f15-b44f-86a3a32756c7-host\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.102200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-systemd-units\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrbq9\" (UniqueName: \"kubernetes.io/projected/740767ae-217d-4f15-b44f-86a3a32756c7-kube-api-access-vrbq9\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740767ae-217d-4f15-b44f-86a3a32756c7-host\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-registration-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-lib-modules\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-netns\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-socket-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.102466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c011349c-0d8c-4311-86c1-cbc3fe77fe10-agent-certs\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68s75\" (UniqueName: \"kubernetes.io/projected/46d5a4f3-3b75-4241-808f-9768284406bf-kube-api-access-68s75\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/799257dd-9b4a-46b8-a640-10820b10068a-iptables-alerter-script\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysconfig\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.102862    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 21:22:13.103099 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-host\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-k8s-cni-cncf-io\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-systemd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-conf\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-kubelet\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-script-lib\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-hostroot\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-systemd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2kx8\" (UniqueName: \"kubernetes.io/projected/e92a951e-676d-4c93-a1cb-62db723977d0-kube-api-access-r2kx8\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5cq\" (UniqueName: \"kubernetes.io/projected/5236e65d-3ba7-4610-affc-745b573e6ab7-kube-api-access-vn5cq\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.103435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nfz6\" (UniqueName: \"kubernetes.io/projected/01888eea-6fc1-4a60-967c-48870b6e30b2-kube-api-access-2nfz6\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/799257dd-9b4a-46b8-a640-10820b10068a-host-slash\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-tmp\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-bin\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-env-overrides\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c011349c-0d8c-4311-86c1-cbc3fe77fe10-konnectivity-ca\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-bin\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bc7979-d12b-43db-87d5-c52b0936c85f-tmp-dir\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-cnibin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-multus-daemon-config\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.104187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-ovn\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-log-socket\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740767ae-217d-4f15-b44f-86a3a32756c7-serviceca\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-tuned\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-os-release\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-multus-certs\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.103994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-system-cni-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vd2s\" (UniqueName: \"kubernetes.io/projected/799257dd-9b4a-46b8-a640-10820b10068a-kube-api-access-9vd2s\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-env-overrides\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-kubelet\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-config\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-os-release\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.104952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-log-socket\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c011349c-0d8c-4311-86c1-cbc3fe77fe10-konnectivity-ca\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.104244    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.104350    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:13.604315257 +0000 UTC m=+3.029264310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bc7979-d12b-43db-87d5-c52b0936c85f-tmp-dir\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-run-ovn\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-kubelet-config\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.104634    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740767ae-217d-4f15-b44f-86a3a32756c7-serviceca\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67bc7979-d12b-43db-87d5-c52b0936c85f-hosts-file\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.104683    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:13.604665967 +0000 UTC m=+3.029614989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67bc7979-d12b-43db-87d5-c52b0936c85f-hosts-file\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxws\" (UniqueName: \"kubernetes.io/projected/67bc7979-d12b-43db-87d5-c52b0936c85f-kube-api-access-rkxws\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.105656 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-kubelet\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-kubelet-config\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-sys-fs\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-modprobe-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-run\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-sys\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.104969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-socket-dir-parent\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-netns\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-etc-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-run-netns\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-etc-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76sgw\" (UniqueName: \"kubernetes.io/projected/e5642455-1f34-4413-94b2-7b97ecb5560d-kube-api-access-76sgw\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-systemd\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-var-lib-kubelet\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.106417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-bin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-conf-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-device-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-slash\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-var-lib-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-node-log\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qd9\" (UniqueName: \"kubernetes.io/projected/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-kube-api-access-s2qd9\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-slash\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-cnibin\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-system-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-node-log\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-etc-kubernetes\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-netd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-var-lib-openvswitch\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107142 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovn-node-metrics-cert\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-kubernetes\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovnkube-config\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-cni-binary-copy\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-host-cni-netd\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-multus\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.105961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-dbus\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.107824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.106107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a57d9cf8-0780-4a6b-b71b-f0751418d02c-dbus\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.110634 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.109972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-ovn-node-metrics-cert\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.112183 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.112160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c011349c-0d8c-4311-86c1-cbc3fe77fe10-agent-certs\") pod \"konnectivity-agent-8kzp5\" (UID: \"c011349c-0d8c-4311-86c1-cbc3fe77fe10\") " pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.116500 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.116299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68s75\" (UniqueName: \"kubernetes.io/projected/46d5a4f3-3b75-4241-808f-9768284406bf-kube-api-access-68s75\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.117512 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.117490    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:13.117616 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.117518    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:13.117616 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.117534    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:13.117616 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.117591    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:13.617572738 +0000 UTC m=+3.042521776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:13.120439 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.120367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrbq9\" (UniqueName: \"kubernetes.io/projected/740767ae-217d-4f15-b44f-86a3a32756c7-kube-api-access-vrbq9\") pod \"node-ca-mclf9\" (UID: \"740767ae-217d-4f15-b44f-86a3a32756c7\") " pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.124070 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.122676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qd9\" (UniqueName: \"kubernetes.io/projected/91d948eb-ef4a-4fa3-b0a2-9919ea6c6223-kube-api-access-s2qd9\") pod \"ovnkube-node-2bdzr\" (UID: \"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.124626 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.124509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxws\" (UniqueName: \"kubernetes.io/projected/67bc7979-d12b-43db-87d5-c52b0936c85f-kube-api-access-rkxws\") pod \"node-resolver-gvp4g\" (UID: \"67bc7979-d12b-43db-87d5-c52b0936c85f\") " pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.169139 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.169076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal" event={"ID":"50b77399a04a40a30518adb675dba5f5","Type":"ContainerStarted","Data":"5b4cab8e73d836c7d148ffa7663ea187e0f0ba7bff6a54b7bffd95e64b4b9688"}
Jul 13 21:22:13.170668 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.170592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal" event={"ID":"af6932374b5d843067eb5a100f1bbb82","Type":"ContainerStarted","Data":"2b9e3560e0b2dab58b424bfbbfd03f084636b190f291f7a172246230849e7b57"}
Jul 13 21:22:13.206883 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.206838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.206897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-sys-fs\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.206942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-modprobe-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.206969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-run\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.206993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-sys\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-socket-dir-parent\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76sgw\" (UniqueName: \"kubernetes.io/projected/e5642455-1f34-4413-94b2-7b97ecb5560d-kube-api-access-76sgw\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.207086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-systemd\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-var-lib-kubelet\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-bin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-conf-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-device-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-cnibin\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-system-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-etc-kubernetes\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-kubernetes\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-cni-binary-copy\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-multus\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.207461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-registration-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-var-lib-kubelet\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-bin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-conf-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-lib-modules\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-netns\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-socket-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-sys\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/799257dd-9b4a-46b8-a640-10820b10068a-iptables-alerter-script\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysconfig\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-multus-socket-dir-parent\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-host\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-k8s-cni-cncf-io\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-conf\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-kubelet\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-hostroot\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2kx8\" (UniqueName: \"kubernetes.io/projected/e92a951e-676d-4c93-a1cb-62db723977d0-kube-api-access-r2kx8\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-cni-multus\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5cq\" (UniqueName: \"kubernetes.io/projected/5236e65d-3ba7-4610-affc-745b573e6ab7-kube-api-access-vn5cq\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nfz6\" (UniqueName: \"kubernetes.io/projected/01888eea-6fc1-4a60-967c-48870b6e30b2-kube-api-access-2nfz6\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-systemd\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/799257dd-9b4a-46b8-a640-10820b10068a-host-slash\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/799257dd-9b4a-46b8-a640-10820b10068a-host-slash\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-tmp\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-cnibin\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.207512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-etc-kubernetes\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.208927 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-kubernetes\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-lib-modules\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-netns\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-socket-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-device-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-system-cni-dir\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-sys-fs\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-registration-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-modprobe-d\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-run\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-cnibin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-multus-daemon-config\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.209657 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-tuned\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-os-release\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/799257dd-9b4a-46b8-a640-10820b10068a-iptables-alerter-script\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-multus-certs\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-system-cni-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysconfig\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.208999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vd2s\" (UniqueName: \"kubernetes.io/projected/799257dd-9b4a-46b8-a640-10820b10068a-kube-api-access-9vd2s\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-cnibin\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-host\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-k8s-cni-cncf-io\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-os-release\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-hostroot\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.210421 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-os-release\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-cni-binary-copy\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-sysctl-conf\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-var-lib-kubelet\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e92a951e-676d-4c93-a1cb-62db723977d0-host-run-multus-certs\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-os-release\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e92a951e-676d-4c93-a1cb-62db723977d0-multus-daemon-config\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01888eea-6fc1-4a60-967c-48870b6e30b2-system-cni-dir\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01888eea-6fc1-4a60-967c-48870b6e30b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.211193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.209636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5642455-1f34-4413-94b2-7b97ecb5560d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.212628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.212421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-etc-tuned\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.212628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.212584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5236e65d-3ba7-4610-affc-745b573e6ab7-tmp\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.218139 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.218089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76sgw\" (UniqueName: \"kubernetes.io/projected/e5642455-1f34-4413-94b2-7b97ecb5560d-kube-api-access-76sgw\") pod \"aws-ebs-csi-driver-node-5hmv5\" (UID: \"e5642455-1f34-4413-94b2-7b97ecb5560d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.219886 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.218671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2kx8\" (UniqueName: \"kubernetes.io/projected/e92a951e-676d-4c93-a1cb-62db723977d0-kube-api-access-r2kx8\") pod \"multus-cd7sl\" (UID: \"e92a951e-676d-4c93-a1cb-62db723977d0\") " pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.219886 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.219186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5cq\" (UniqueName: \"kubernetes.io/projected/5236e65d-3ba7-4610-affc-745b573e6ab7-kube-api-access-vn5cq\") pod \"tuned-jnjjb\" (UID: \"5236e65d-3ba7-4610-affc-745b573e6ab7\") " pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.220051 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.219881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vd2s\" (UniqueName: \"kubernetes.io/projected/799257dd-9b4a-46b8-a640-10820b10068a-kube-api-access-9vd2s\") pod \"iptables-alerter-n2bcz\" (UID: \"799257dd-9b4a-46b8-a640-10820b10068a\") " pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.221223 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.221177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nfz6\" (UniqueName: \"kubernetes.io/projected/01888eea-6fc1-4a60-967c-48870b6e30b2-kube-api-access-2nfz6\") pod \"multus-additional-cni-plugins-txrx5\" (UID: \"01888eea-6fc1-4a60-967c-48870b6e30b2\") " pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.297553 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.297512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvp4g"
Jul 13 21:22:13.307859 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.307565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:13.317846 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.317816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:13.326152 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.326069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mclf9"
Jul 13 21:22:13.337028 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.336996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txrx5"
Jul 13 21:22:13.356041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.356008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2bcz"
Jul 13 21:22:13.367151 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.367093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5"
Jul 13 21:22:13.377181 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.377124    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnjjb"
Jul 13 21:22:13.385336 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.385313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cd7sl"
Jul 13 21:22:13.476046 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.475959    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:22:13.612459 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.612418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:13.612459 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.612469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:13.612747 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.612593    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:13.612747 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.612596    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:13.612747 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.612657    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:14.612637278 +0000 UTC m=+4.037586300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:13.612747 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.612677    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:14.612666363 +0000 UTC m=+4.037615384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:13.713636 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:13.713592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:13.713855 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.713816    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:13.713855 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.713845    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:13.713974 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.713861    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:13.713974 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:13.713927    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:14.713911463 +0000 UTC m=+4.138860500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:14.030252 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.030207    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:17:13 +0000 UTC" deadline="2028-02-13 14:30:17.695966461 +0000 UTC"
Jul 13 21:22:14.030252 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.030235    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13913h8m3.665734814s"
Jul 13 21:22:14.163413 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.163373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:14.163616 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.163514    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:14.163616 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.163569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:14.163730 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.163680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:14.377034 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.377002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5642455_1f34_4413_94b2_7b97ecb5560d.slice/crio-daa0714d4b536eb47834f48e10067e9202ed10d0ff77adaae8fcf1efa3ef24a7 WatchSource:0}: Error finding container daa0714d4b536eb47834f48e10067e9202ed10d0ff77adaae8fcf1efa3ef24a7: Status 404 returned error can't find the container with id daa0714d4b536eb47834f48e10067e9202ed10d0ff77adaae8fcf1efa3ef24a7
Jul 13 21:22:14.379368 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.379245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc011349c_0d8c_4311_86c1_cbc3fe77fe10.slice/crio-d369ed7442869a3f85a63bafd981d3ac2389ff1010b786a4aab1fcb7cb198ac5 WatchSource:0}: Error finding container d369ed7442869a3f85a63bafd981d3ac2389ff1010b786a4aab1fcb7cb198ac5: Status 404 returned error can't find the container with id d369ed7442869a3f85a63bafd981d3ac2389ff1010b786a4aab1fcb7cb198ac5
Jul 13 21:22:14.383537 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.383509    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92a951e_676d_4c93_a1cb_62db723977d0.slice/crio-4880246f69fd6ac370e5bcc634633f2257dca87f6e314d42f31c4cc02a4301cd WatchSource:0}: Error finding container 4880246f69fd6ac370e5bcc634633f2257dca87f6e314d42f31c4cc02a4301cd: Status 404 returned error can't find the container with id 4880246f69fd6ac370e5bcc634633f2257dca87f6e314d42f31c4cc02a4301cd
Jul 13 21:22:14.383837 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.383788    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5236e65d_3ba7_4610_affc_745b573e6ab7.slice/crio-46466dd3a855471467728e771e617ee50bca3ca8815d0bd66dfa19124d2fb56c WatchSource:0}: Error finding container 46466dd3a855471467728e771e617ee50bca3ca8815d0bd66dfa19124d2fb56c: Status 404 returned error can't find the container with id 46466dd3a855471467728e771e617ee50bca3ca8815d0bd66dfa19124d2fb56c
Jul 13 21:22:14.410868 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.410836    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bc7979_d12b_43db_87d5_c52b0936c85f.slice/crio-e9e09bbdec5e4bcc9e32f3d29b6354a744887483255d302a9e19fc9cd854690c WatchSource:0}: Error finding container e9e09bbdec5e4bcc9e32f3d29b6354a744887483255d302a9e19fc9cd854690c: Status 404 returned error can't find the container with id e9e09bbdec5e4bcc9e32f3d29b6354a744887483255d302a9e19fc9cd854690c
Jul 13 21:22:14.411571 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.411546    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740767ae_217d_4f15_b44f_86a3a32756c7.slice/crio-86d80afb08d249bdeaa97c8f39584feadf59e93c18ebcfdd83a095fc05e88c1b WatchSource:0}: Error finding container 86d80afb08d249bdeaa97c8f39584feadf59e93c18ebcfdd83a095fc05e88c1b: Status 404 returned error can't find the container with id 86d80afb08d249bdeaa97c8f39584feadf59e93c18ebcfdd83a095fc05e88c1b
Jul 13 21:22:14.413605 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.413497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d948eb_ef4a_4fa3_b0a2_9919ea6c6223.slice/crio-fdab948b0519aba646a13c2191a67a7d1ae41360c995be34266835bd8b7ef799 WatchSource:0}: Error finding container fdab948b0519aba646a13c2191a67a7d1ae41360c995be34266835bd8b7ef799: Status 404 returned error can't find the container with id fdab948b0519aba646a13c2191a67a7d1ae41360c995be34266835bd8b7ef799
Jul 13 21:22:14.415271 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.415247    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799257dd_9b4a_46b8_a640_10820b10068a.slice/crio-0b390f50b771da122fb4a87c66ad0c0ff700ec7ee29a08faf7deff0bdb7b1069 WatchSource:0}: Error finding container 0b390f50b771da122fb4a87c66ad0c0ff700ec7ee29a08faf7deff0bdb7b1069: Status 404 returned error can't find the container with id 0b390f50b771da122fb4a87c66ad0c0ff700ec7ee29a08faf7deff0bdb7b1069
Jul 13 21:22:14.417946 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:14.417891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01888eea_6fc1_4a60_967c_48870b6e30b2.slice/crio-60c79801e6b11dd2cc76a96c2dd5208f2cf06bb97c79ca7a0b4808fde6e23cab WatchSource:0}: Error finding container 60c79801e6b11dd2cc76a96c2dd5208f2cf06bb97c79ca7a0b4808fde6e23cab: Status 404 returned error can't find the container with id 60c79801e6b11dd2cc76a96c2dd5208f2cf06bb97c79ca7a0b4808fde6e23cab
Jul 13 21:22:14.621010 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.620820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:14.621154 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.621029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:14.621154 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.620991    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:14.621154 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.621124    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:14.621309 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.621176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:16.621160498 +0000 UTC m=+6.046109518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:14.621309 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.621191    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:16.621183887 +0000 UTC m=+6.046132907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:14.721921 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:14.721875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:14.722109 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.722055    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:14.722109 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.722076    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:14.722109 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.722086    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:14.722234 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:14.722171    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:16.722152403 +0000 UTC m=+6.147101442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:15.030811 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.030635    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:17:13 +0000 UTC" deadline="2028-01-28 05:09:37.910318712 +0000 UTC"
Jul 13 21:22:15.030811 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.030704    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13519h47m22.87961936s"
Jul 13 21:22:15.169318 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.168789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:15.169318 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:15.168942    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:15.206464 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.206394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerStarted","Data":"60c79801e6b11dd2cc76a96c2dd5208f2cf06bb97c79ca7a0b4808fde6e23cab"}
Jul 13 21:22:15.224673 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.224630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mclf9" event={"ID":"740767ae-217d-4f15-b44f-86a3a32756c7","Type":"ContainerStarted","Data":"86d80afb08d249bdeaa97c8f39584feadf59e93c18ebcfdd83a095fc05e88c1b"}
Jul 13 21:22:15.230828 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.230463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvp4g" event={"ID":"67bc7979-d12b-43db-87d5-c52b0936c85f","Type":"ContainerStarted","Data":"e9e09bbdec5e4bcc9e32f3d29b6354a744887483255d302a9e19fc9cd854690c"}
Jul 13 21:22:15.235722 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.235684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnjjb" event={"ID":"5236e65d-3ba7-4610-affc-745b573e6ab7","Type":"ContainerStarted","Data":"46466dd3a855471467728e771e617ee50bca3ca8815d0bd66dfa19124d2fb56c"}
Jul 13 21:22:15.239883 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.239835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cd7sl" event={"ID":"e92a951e-676d-4c93-a1cb-62db723977d0","Type":"ContainerStarted","Data":"4880246f69fd6ac370e5bcc634633f2257dca87f6e314d42f31c4cc02a4301cd"}
Jul 13 21:22:15.250006 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.249881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5" event={"ID":"e5642455-1f34-4413-94b2-7b97ecb5560d","Type":"ContainerStarted","Data":"daa0714d4b536eb47834f48e10067e9202ed10d0ff77adaae8fcf1efa3ef24a7"}
Jul 13 21:22:15.258283 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.258245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal" event={"ID":"af6932374b5d843067eb5a100f1bbb82","Type":"ContainerStarted","Data":"ce61e1acac59699783257c3b672fbe0f27f547a211494c3fb0d5fbbed1d22ff0"}
Jul 13 21:22:15.266166 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.266111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2bcz" event={"ID":"799257dd-9b4a-46b8-a640-10820b10068a","Type":"ContainerStarted","Data":"0b390f50b771da122fb4a87c66ad0c0ff700ec7ee29a08faf7deff0bdb7b1069"}
Jul 13 21:22:15.291672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.291566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"fdab948b0519aba646a13c2191a67a7d1ae41360c995be34266835bd8b7ef799"}
Jul 13 21:22:15.316158 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.316039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8kzp5" event={"ID":"c011349c-0d8c-4311-86c1-cbc3fe77fe10","Type":"ContainerStarted","Data":"d369ed7442869a3f85a63bafd981d3ac2389ff1010b786a4aab1fcb7cb198ac5"}
Jul 13 21:22:15.337023 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.336897    2565 generic.go:356] "Generic (PLEG): container finished" podID="50b77399a04a40a30518adb675dba5f5" containerID="6624d9f30271e151dcb053e95119b6419f45021417e13cd4d9a852d4be1bbdc4" exitCode=0
Jul 13 21:22:15.337023 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.336951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal" event={"ID":"50b77399a04a40a30518adb675dba5f5","Type":"ContainerDied","Data":"6624d9f30271e151dcb053e95119b6419f45021417e13cd4d9a852d4be1bbdc4"}
Jul 13 21:22:15.353972 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:15.352283    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-49.ec2.internal" podStartSLOduration=2.352258013 podStartE2EDuration="2.352258013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:15.274690983 +0000 UTC m=+4.699640028" watchObservedRunningTime="2026-07-13 21:22:15.352258013 +0000 UTC m=+4.777207059"
Jul 13 21:22:16.164880 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.163919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:16.164880 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.164090    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:16.164880 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.164695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:16.164880 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.164811    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:16.375308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.375262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal" event={"ID":"50b77399a04a40a30518adb675dba5f5","Type":"ContainerStarted","Data":"a29f58f213a838e388b6f472f86261861bf1495098f1e74b65181894bc770d82"}
Jul 13 21:22:16.640543 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.640496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:16.640791 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.640559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:16.640791 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.640702    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:16.640791 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.640767    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:20.640748047 +0000 UTC m=+10.065697071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:16.641296 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.641272    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:16.641401 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.641340    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:20.641322639 +0000 UTC m=+10.066271665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:16.742445 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:16.741693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:16.742445 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.741953    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:16.742445 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.741977    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:16.742445 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.741991    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:16.742445 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:16.742058    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:20.742038354 +0000 UTC m=+10.166987390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:17.166095 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:17.166056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:17.166678 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:17.166232    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:18.164180 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:18.164143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:18.164403 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:18.164143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:18.164403 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:18.164317    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:18.164403 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:18.164393    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:19.163430 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:19.163400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:19.163927 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:19.163524    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:20.164195 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:20.164152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:20.164723 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.164307    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:20.164723 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:20.164374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:20.164723 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.164472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:20.677480 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:20.677389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:20.677692 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:20.677508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:20.677692 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.677537    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:20.677692 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.677623    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:20.677692 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.677624    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:28.677602287 +0000 UTC m=+18.102551333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:20.677692 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.677690    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:28.677672727 +0000 UTC m=+18.102621755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:20.777923 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:20.777886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:20.778134 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.778097    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:20.778134 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.778121    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:20.778134 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.778134    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:20.778290 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:20.778200    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:28.7781797 +0000 UTC m=+18.203128739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:21.165243 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:21.165200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:21.165723 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:21.165328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:22.163571 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:22.163538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:22.163571 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:22.163562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:22.163802 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:22.163685    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:22.164088 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:22.164025    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:23.164478 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:23.164441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:23.164973 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:23.164577    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:24.164058 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:24.163960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:24.164058 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:24.163996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:24.164301 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:24.164084    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:24.164508 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:24.164478    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:25.164173 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:25.164138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:25.164331 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:25.164260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:26.163591 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:26.163554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:26.164034 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:26.163680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:26.164034 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:26.163751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:26.164034 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:26.163887    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:27.163885 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:27.163841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:27.164359 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:27.163988    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:28.164063 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:28.164025    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:28.164545 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:28.164030    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:28.164545 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.164148    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:28.164545 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.164276    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:28.747864 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:28.747831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:28.747864 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:28.747876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:28.748091 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.748014    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:28.748091 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.748089    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:22:44.748068849 +0000 UTC m=+34.173017868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:28.748200 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.748020    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:28.748200 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.748194    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:44.748163242 +0000 UTC m=+34.173112274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:28.848604 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:28.848563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:28.848761 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.848735    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:28.848850 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.848761    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:28.848850 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.848774    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:28.848850 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:28.848846    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:22:44.848831578 +0000 UTC m=+34.273780597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:29.164127 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:29.164089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:29.164626 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:29.164221    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:30.163473 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:30.163437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:30.163668 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:30.163437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:30.163668 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:30.163576    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:30.163668 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:30.163645    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:31.164473 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:31.164434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:31.164970 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:31.164554    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:32.164096 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:32.164059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:32.164291 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:32.164193    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:32.164291 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:32.164250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:32.164404 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:32.164387    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:33.163998 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:33.163961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:33.164562 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:33.164087    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:34.163817 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.163484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:34.163942 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.163484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:34.163942 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:34.163908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:34.164043 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:34.164021    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:34.413426 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.413383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cd7sl" event={"ID":"e92a951e-676d-4c93-a1cb-62db723977d0","Type":"ContainerStarted","Data":"97cd54daaa12017a35a439bf8a43d126ceb45b58ea3261416bcfd922e6f1d3d8"}
Jul 13 21:22:34.415059 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.415034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5" event={"ID":"e5642455-1f34-4413-94b2-7b97ecb5560d","Type":"ContainerStarted","Data":"be2bef74ebcbc442ea51e9171a07fe17dc0aa5969c531e703f5ff75a09b8ec7b"}
Jul 13 21:22:34.417862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.417838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:22:34.418209 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418190    2565 generic.go:356] "Generic (PLEG): container finished" podID="91d948eb-ef4a-4fa3-b0a2-9919ea6c6223" containerID="017b26819f66c3750e76ea7cfa076b0e8286574de2feeef663484be368b5af0b" exitCode=1
Jul 13 21:22:34.418306 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"484ab2ec3a46bf9ea3e9fc24341f7b10b50fac15bbec6dd9e9e761257843fbd3"}
Jul 13 21:22:34.418375 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"1bd9e91fcd2709917acff9d05ff81cfc92537e7b29fdb0c65859bf8cd1ed5351"}
Jul 13 21:22:34.418414 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"9c3c4cddf437a8784a24b2fa83bd0d0b786cd52298e88a9d569057561687a610"}
Jul 13 21:22:34.418454 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"fca16a7169508abf634c0af18af47d65ce6eac86fd57bfb0882f89c297ba0969"}
Jul 13 21:22:34.418515 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerDied","Data":"017b26819f66c3750e76ea7cfa076b0e8286574de2feeef663484be368b5af0b"}
Jul 13 21:22:34.418563 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.418541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"bdb54e7dc32ff676561e140fc00f1b7052a8993e460661b23cb732743345e9e5"}
Jul 13 21:22:34.419641 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.419620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8kzp5" event={"ID":"c011349c-0d8c-4311-86c1-cbc3fe77fe10","Type":"ContainerStarted","Data":"db8252bbf1a17a7b83c5d529926ddb13e1d9e5070b3336825acf07dfa50c596d"}
Jul 13 21:22:34.421188 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.421165    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="c8c758154b7f1f5619e7465563b17621dc327ad4fa709eab42206ed145c8c9d6" exitCode=0
Jul 13 21:22:34.421288 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.421240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"c8c758154b7f1f5619e7465563b17621dc327ad4fa709eab42206ed145c8c9d6"}
Jul 13 21:22:34.423330 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.423176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mclf9" event={"ID":"740767ae-217d-4f15-b44f-86a3a32756c7","Type":"ContainerStarted","Data":"8d17b79703cb1e11ffe09869fe128b488c66a4713d096cda17f7ab6ba34749ae"}
Jul 13 21:22:34.424701 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.424661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvp4g" event={"ID":"67bc7979-d12b-43db-87d5-c52b0936c85f","Type":"ContainerStarted","Data":"4063a15fafadaaf1c54d4f470009b5be65f25c12864ba293b1d5e358f22dd11f"}
Jul 13 21:22:34.426417 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.426384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnjjb" event={"ID":"5236e65d-3ba7-4610-affc-745b573e6ab7","Type":"ContainerStarted","Data":"0f50abf2b531b83640bef958f755ba726eb2969993c6eb2a00af5f8917e8d2f2"}
Jul 13 21:22:34.430240 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.430205    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cd7sl" podStartSLOduration=3.305490693 podStartE2EDuration="22.430193149s" totalImagesPullingTime="19.124702456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:34.43002295 +0000 UTC m=+23.854971994" watchObservedRunningTime="2026-07-13 21:22:34.430193149 +0000 UTC m=+23.855142191"
Jul 13 21:22:34.430637 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.430613    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-49.ec2.internal" podStartSLOduration=21.430606761 podStartE2EDuration="21.430606761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:16.390844434 +0000 UTC m=+5.815793479" watchObservedRunningTime="2026-07-13 21:22:34.430606761 +0000 UTC m=+23.855555802"
Jul 13 21:22:34.443493 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.443445    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gvp4g" podStartSLOduration=4.389110811 podStartE2EDuration="23.44341967s" totalImagesPullingTime="19.054308859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:34.443115683 +0000 UTC m=+23.868064737" watchObservedRunningTime="2026-07-13 21:22:34.44341967 +0000 UTC m=+23.868368708"
Jul 13 21:22:34.478754 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.478688    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8kzp5" podStartSLOduration=3.391824377 podStartE2EDuration="22.478640784s" totalImagesPullingTime="19.086816407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:34.477918067 +0000 UTC m=+23.902867109" watchObservedRunningTime="2026-07-13 21:22:34.478640784 +0000 UTC m=+23.903589826"
Jul 13 21:22:34.507848 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.507774    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jnjjb" podStartSLOduration=3.433217843 podStartE2EDuration="22.507757967s" totalImagesPullingTime="19.074540124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:34.507627754 +0000 UTC m=+23.932576794" watchObservedRunningTime="2026-07-13 21:22:34.507757967 +0000 UTC m=+23.932707007"
Jul 13 21:22:34.508342 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:34.508309    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mclf9" podStartSLOduration=3.453388455 podStartE2EDuration="22.508298255s" totalImagesPullingTime="19.0549098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:34.49158646 +0000 UTC m=+23.916535500" watchObservedRunningTime="2026-07-13 21:22:34.508298255 +0000 UTC m=+23.933247356"
Jul 13 21:22:35.046940 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.046900    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 21:22:35.079710 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.079602    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T21:22:35.046922022Z","UUID":"fdae21bf-3575-4e99-a8e7-086d8b6cb1b3","Handler":null,"Name":"","Endpoint":""}
Jul 13 21:22:35.082097 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.082072    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 21:22:35.082239 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.082114    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 21:22:35.163711 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.163636    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:35.163962 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:35.163767    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:35.430569 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.430486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5" event={"ID":"e5642455-1f34-4413-94b2-7b97ecb5560d","Type":"ContainerStarted","Data":"4d75008ad0d67eec61847bf6f2d155e2a46a2b523bd651f9e6892f4f8062e783"}
Jul 13 21:22:35.431949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.431921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2bcz" event={"ID":"799257dd-9b4a-46b8-a640-10820b10068a","Type":"ContainerStarted","Data":"5648c97a3fabdb5a9c5b26e78698bcb53ea651421dbc1052554fdd0290deaba8"}
Jul 13 21:22:35.445495 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.445449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2bcz" podStartSLOduration=4.392672572 podStartE2EDuration="23.445436418s" totalImagesPullingTime="19.052763846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:35.444743951 +0000 UTC m=+24.869692993" watchObservedRunningTime="2026-07-13 21:22:35.445436418 +0000 UTC m=+24.870385705"
Jul 13 21:22:35.602998 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.602928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:35.603671 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:35.603645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:36.163739 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.163687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:36.164010 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:36.163831    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:36.164010 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.163882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:36.164235 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:36.164018    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:36.442298 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.442271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:22:36.442756 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.442729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"a244d188411e8f45bf6148704f84675e6372a5872104b39feecca3098f704fc7"}
Jul 13 21:22:36.444924 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.444895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5" event={"ID":"e5642455-1f34-4413-94b2-7b97ecb5560d","Type":"ContainerStarted","Data":"69666d31b86d802eaace659abe5f0562c7f6db41af2450c3b7f883c243cb9b57"}
Jul 13 21:22:36.445491 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.445430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:36.445611 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.445547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8kzp5"
Jul 13 21:22:36.461533 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:36.461480    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hmv5" podStartSLOduration=3.102724699 podStartE2EDuration="24.461461065s" totalImagesPullingTime="21.358736366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:36.461311609 +0000 UTC m=+25.886260650" watchObservedRunningTime="2026-07-13 21:22:36.461461065 +0000 UTC m=+25.886410107"
Jul 13 21:22:37.164244 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:37.164207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:37.164447 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:37.164341    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:38.163702 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:38.163493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:38.164163 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:38.163493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:38.164163 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:38.163828    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:38.164163 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:38.163891    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:39.164362 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.164334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:39.165065 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:39.164444    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:39.453355 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.453194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerStarted","Data":"7412d6162405419d3590af899d464f2689f603d42870a935abde8032e911cbd7"}
Jul 13 21:22:39.456556 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.456538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:22:39.456959 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.456935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"2d8b1a3c14f2aa625667eb200e0494b176813faa3986d410b3904b8b29f548d5"}
Jul 13 21:22:39.457263 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.457238    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:39.457377 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.457317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:39.457441 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.457405    2565 scope.go:117] "RemoveContainer" containerID="017b26819f66c3750e76ea7cfa076b0e8286574de2feeef663484be368b5af0b"
Jul 13 21:22:39.474892 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:39.474863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:40.164135 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.164102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:40.164356 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:40.164209    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:40.164356 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.164268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:40.164900 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:40.164354    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:40.460388 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.460310    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="7412d6162405419d3590af899d464f2689f603d42870a935abde8032e911cbd7" exitCode=0
Jul 13 21:22:40.460580 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.460398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"7412d6162405419d3590af899d464f2689f603d42870a935abde8032e911cbd7"}
Jul 13 21:22:40.464084 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.464066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:22:40.464445 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.464419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" event={"ID":"91d948eb-ef4a-4fa3-b0a2-9919ea6c6223","Type":"ContainerStarted","Data":"18979f3663a0ab2088b8c51d5b99dead09121055b3cea98d914aa5239e5303b7"}
Jul 13 21:22:40.464637 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.464618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:40.480424 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.480391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:22:40.540294 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:40.540241    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr" podStartSLOduration=9.404871096 podStartE2EDuration="28.540227093s" totalImagesPullingTime="19.135355997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:40.538399847 +0000 UTC m=+29.963348890" watchObservedRunningTime="2026-07-13 21:22:40.540227093 +0000 UTC m=+29.965176133"
Jul 13 21:22:41.164540 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:41.164503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:41.165033 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:41.164594    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:42.163621 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:42.163589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:42.163817 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:42.163694    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:42.163817 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:42.163751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:42.163900 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:42.163853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:42.470438 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:42.470340    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="26d4972ce3874775dbda00d2bbe94123b5d60a43748431bcbba8294f44393615" exitCode=0
Jul 13 21:22:42.470438 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:42.470422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"26d4972ce3874775dbda00d2bbe94123b5d60a43748431bcbba8294f44393615"}
Jul 13 21:22:43.163760 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:43.163724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:43.163978 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:43.163877    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:44.163740 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.163706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:44.164198 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.163838    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:44.164198 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.163898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:44.164198 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.163992    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:44.477213 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.477136    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="7d694dd5330dbe2071ad3610ecdbe740a111f51544122f7d77daef6ed329f563" exitCode=0
Jul 13 21:22:44.477213 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.477195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"7d694dd5330dbe2071ad3610ecdbe740a111f51544122f7d77daef6ed329f563"}
Jul 13 21:22:44.769773 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.769695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:44.769773 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.769728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:44.769966 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.769854    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:44.769966 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.769856    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:44.769966 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.769908    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret podName:a57d9cf8-0780-4a6b-b71b-f0751418d02c nodeName:}" failed. No retries permitted until 2026-07-13 21:23:16.769893694 +0000 UTC m=+66.194842714 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret") pod "global-pull-secret-syncer-wq8dc" (UID: "a57d9cf8-0780-4a6b-b71b-f0751418d02c") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:44.769966 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.769924    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs podName:46d5a4f3-3b75-4241-808f-9768284406bf nodeName:}" failed. No retries permitted until 2026-07-13 21:23:16.769917105 +0000 UTC m=+66.194866124 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs") pod "network-metrics-daemon-zx5cr" (UID: "46d5a4f3-3b75-4241-808f-9768284406bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:44.870898 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:44.870860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:44.871073 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.871048    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:44.871142 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.871076    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:44.871142 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.871092    2565 projected.go:196] Error preparing data for projected volume kube-api-access-j5nxp for pod openshift-network-diagnostics/network-check-target-srvr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:44.871253 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:44.871157    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp podName:fdf2a9e1-c2df-475b-a33e-c205e276095d nodeName:}" failed. No retries permitted until 2026-07-13 21:23:16.871137798 +0000 UTC m=+66.296086837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nxp" (UniqueName: "kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp") pod "network-check-target-srvr6" (UID: "fdf2a9e1-c2df-475b-a33e-c205e276095d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:45.163622 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:45.163589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:45.163826 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:45.163719    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:46.164331 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:46.164296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:46.164831 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:46.164296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:46.164831 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:46.164446    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:46.164831 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:46.164488    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:47.163900 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:47.163863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:47.164079 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:47.163991    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:48.163889 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:48.163849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:48.164355 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:48.163892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:48.164355 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:48.163984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:48.164355 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:48.164104    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:48.489618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:48.489587    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="f3b787deb1b106b62818dbd62f3156930cf43069918c065462228023fb437d4b" exitCode=0
Jul 13 21:22:48.489805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:48.489655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"f3b787deb1b106b62818dbd62f3156930cf43069918c065462228023fb437d4b"}
Jul 13 21:22:49.164310 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:49.164269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:49.164742 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:49.164391    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:49.494908 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:49.494828    2565 generic.go:356] "Generic (PLEG): container finished" podID="01888eea-6fc1-4a60-967c-48870b6e30b2" containerID="4d079e18ba874b888bc6dc6283d3d9e00e99019813e25fa005a309e167510dc7" exitCode=0
Jul 13 21:22:49.494908 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:49.494875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerDied","Data":"4d079e18ba874b888bc6dc6283d3d9e00e99019813e25fa005a309e167510dc7"}
Jul 13 21:22:50.164340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:50.164309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:50.164730 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:50.164314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:50.164730 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:50.164411    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:50.164730 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:50.164495    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:50.500065 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:50.499986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txrx5" event={"ID":"01888eea-6fc1-4a60-967c-48870b6e30b2","Type":"ContainerStarted","Data":"bf6b62f8dab9026807d8d150e3eeaba34c817eb10f8b00eba12e5f811456f8ae"}
Jul 13 21:22:50.523929 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:50.523881    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-txrx5" podStartSLOduration=8.564233373 podStartE2EDuration="38.523866564s" totalImagesPullingTime="29.959633191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:50.523426584 +0000 UTC m=+39.948375624" watchObservedRunningTime="2026-07-13 21:22:50.523866564 +0000 UTC m=+39.948815599"
Jul 13 21:22:51.164859 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:51.164659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:51.165342 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:51.164915    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:52.164104 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:52.164064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:52.164282 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:52.164179    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:52.164282 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:52.164233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:52.164350 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:52.164331    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:53.164042 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.164006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:53.164591 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:53.164149    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:53.653042 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.653009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srvr6"]
Jul 13 21:22:53.653199 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.653120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:53.653244 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:53.653215    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:53.656847 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.656817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wq8dc"]
Jul 13 21:22:53.657009 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.656946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:53.657071 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:53.657053    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:53.657716 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.657647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx5cr"]
Jul 13 21:22:53.657872 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:53.657758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:53.657938 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:53.657889    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:55.163844 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:55.163812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:55.163844 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:55.163843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:55.164521 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:55.163813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:55.164521 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:55.163931    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:55.164521 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:55.163983    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:55.164521 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:55.164065    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:57.163834 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.163781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:57.164252 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.163781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:57.164252 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:57.163908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srvr6" podUID="fdf2a9e1-c2df-475b-a33e-c205e276095d"
Jul 13 21:22:57.164252 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:57.163998    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wq8dc" podUID="a57d9cf8-0780-4a6b-b71b-f0751418d02c"
Jul 13 21:22:57.164252 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.163781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:57.164252 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:22:57.164109    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx5cr" podUID="46d5a4f3-3b75-4241-808f-9768284406bf"
Jul 13 21:22:57.397509 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.397476    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-49.ec2.internal" event="NodeReady"
Jul 13 21:22:57.397680 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.397637    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 21:22:57.433773 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.433710    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df8554cf9-2d9s6"]
Jul 13 21:22:57.458715 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.458684    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jvr2b"]
Jul 13 21:22:57.458888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.458833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.462082 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.461839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 21:22:57.462405 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.462385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 21:22:57.462515 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.462447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 21:22:57.462905 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.462881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-58sx4\""
Jul 13 21:22:57.468736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.468716    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 21:22:57.470014 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.469987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-installation-pull-secrets\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470109 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-bound-sa-token\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470163 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d0d54f9-7baa-426d-9897-3e48d363996e-ca-trust-extracted\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470163 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-trusted-ca\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470256 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-certificates\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470256 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-tls\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-image-registry-private-configuration\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.470360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.470278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l72rd\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-kube-api-access-l72rd\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.471104 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.471089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.471221 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.471089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df8554cf9-2d9s6"]
Jul 13 21:22:57.471302 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.471262    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p5v8q"]
Jul 13 21:22:57.473394 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.473375    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 21:22:57.473394 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.473391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 21:22:57.473646 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.473629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9ws2\""
Jul 13 21:22:57.492723 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.492692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvr2b"]
Jul 13 21:22:57.492723 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.492728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p5v8q"]
Jul 13 21:22:57.492925 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.492823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.496040 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.496022    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 21:22:57.496254 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.496242    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 21:22:57.496351 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.496296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hgkt5\""
Jul 13 21:22:57.496404 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.496368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 21:22:57.554501 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.554468    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7jtjk"]
Jul 13 21:22:57.571155 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjsr\" (UniqueName: \"kubernetes.io/projected/bed13a5b-934b-4a52-bafe-49050de274cc-kube-api-access-knjsr\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d0d54f9-7baa-426d-9897-3e48d363996e-ca-trust-extracted\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-trusted-ca\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p75zz\" (UniqueName: \"kubernetes.io/projected/45be4650-4057-4814-970b-7519a07c7e5a-kube-api-access-p75zz\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bed13a5b-934b-4a52-bafe-49050de274cc-metrics-tls\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-certificates\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571335 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed13a5b-934b-4a52-bafe-49050de274cc-tmp-dir\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.571612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-tls\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45be4650-4057-4814-970b-7519a07c7e5a-cert\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.571612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-image-registry-private-configuration\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l72rd\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-kube-api-access-l72rd\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571612 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-installation-pull-secrets\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571870 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d0d54f9-7baa-426d-9897-3e48d363996e-ca-trust-extracted\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571870 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-bound-sa-token\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.571870 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.571721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bed13a5b-934b-4a52-bafe-49050de274cc-config-volume\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.572136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.572111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-certificates\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.572374 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.572349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d54f9-7baa-426d-9897-3e48d363996e-trusted-ca\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.574771 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.574742    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jtjk"]
Jul 13 21:22:57.574914 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.574901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.576470 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.576445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-installation-pull-secrets\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.576470 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.576461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-registry-tls\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.576601 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.576483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d0d54f9-7baa-426d-9897-3e48d363996e-image-registry-private-configuration\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.577478 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.577464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 21:22:57.577690 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.577673    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 21:22:57.577804 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.577750    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 21:22:57.578043 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.578028    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 21:22:57.578154 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.578048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fxsvw\""
Jul 13 21:22:57.579728 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.579701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-bound-sa-token\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.580051 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.580031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l72rd\" (UniqueName: \"kubernetes.io/projected/9d0d54f9-7baa-426d-9897-3e48d363996e-kube-api-access-l72rd\") pod \"image-registry-5df8554cf9-2d9s6\" (UID: \"9d0d54f9-7baa-426d-9897-3e48d363996e\") " pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.672477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bed13a5b-934b-4a52-bafe-49050de274cc-config-volume\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.672477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efbd6fe2-1f27-4373-9b76-e24eda507db6-crio-socket\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.672477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efbd6fe2-1f27-4373-9b76-e24eda507db6-data-volume\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.672477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.672477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4q42\" (UniqueName: \"kubernetes.io/projected/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-api-access-f4q42\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knjsr\" (UniqueName: \"kubernetes.io/projected/bed13a5b-934b-4a52-bafe-49050de274cc-kube-api-access-knjsr\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p75zz\" (UniqueName: \"kubernetes.io/projected/45be4650-4057-4814-970b-7519a07c7e5a-kube-api-access-p75zz\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bed13a5b-934b-4a52-bafe-49050de274cc-metrics-tls\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efbd6fe2-1f27-4373-9b76-e24eda507db6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed13a5b-934b-4a52-bafe-49050de274cc-tmp-dir\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.672888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.672643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45be4650-4057-4814-970b-7519a07c7e5a-cert\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.673134 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.673005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed13a5b-934b-4a52-bafe-49050de274cc-tmp-dir\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.673134 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.673037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bed13a5b-934b-4a52-bafe-49050de274cc-config-volume\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.674936 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.674915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bed13a5b-934b-4a52-bafe-49050de274cc-metrics-tls\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.675047 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.675032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45be4650-4057-4814-970b-7519a07c7e5a-cert\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.681598 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.681580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p75zz\" (UniqueName: \"kubernetes.io/projected/45be4650-4057-4814-970b-7519a07c7e5a-kube-api-access-p75zz\") pod \"ingress-canary-p5v8q\" (UID: \"45be4650-4057-4814-970b-7519a07c7e5a\") " pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.681686 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.681596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjsr\" (UniqueName: \"kubernetes.io/projected/bed13a5b-934b-4a52-bafe-49050de274cc-kube-api-access-knjsr\") pod \"dns-default-jvr2b\" (UID: \"bed13a5b-934b-4a52-bafe-49050de274cc\") " pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.770778 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.770741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:57.772944 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.772921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efbd6fe2-1f27-4373-9b76-e24eda507db6-crio-socket\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773000 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.772952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efbd6fe2-1f27-4373-9b76-e24eda507db6-data-volume\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773000 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.772967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773000 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.772984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4q42\" (UniqueName: \"kubernetes.io/projected/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-api-access-f4q42\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773092 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.773020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efbd6fe2-1f27-4373-9b76-e24eda507db6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773140 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.773124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efbd6fe2-1f27-4373-9b76-e24eda507db6-crio-socket\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.773295 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.773278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efbd6fe2-1f27-4373-9b76-e24eda507db6-data-volume\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.778929 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.778914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:22:57.783136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.783100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.784749 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.784719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efbd6fe2-1f27-4373-9b76-e24eda507db6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.784855 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.784831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4q42\" (UniqueName: \"kubernetes.io/projected/efbd6fe2-1f27-4373-9b76-e24eda507db6-kube-api-access-f4q42\") pod \"insights-runtime-extractor-7jtjk\" (UID: \"efbd6fe2-1f27-4373-9b76-e24eda507db6\") " pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:57.801721 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.801699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p5v8q"
Jul 13 21:22:57.894862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:57.894005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jtjk"
Jul 13 21:22:58.004410 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.004368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvr2b"]
Jul 13 21:22:58.007282 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.007257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df8554cf9-2d9s6"]
Jul 13 21:22:58.009586 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:58.009559    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed13a5b_934b_4a52_bafe_49050de274cc.slice/crio-dece58f2f91ed1d24f964adcda8242668bd8545660028d12e0c04c7f1fe66023 WatchSource:0}: Error finding container dece58f2f91ed1d24f964adcda8242668bd8545660028d12e0c04c7f1fe66023: Status 404 returned error can't find the container with id dece58f2f91ed1d24f964adcda8242668bd8545660028d12e0c04c7f1fe66023
Jul 13 21:22:58.010437 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:58.010407    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0d54f9_7baa_426d_9897_3e48d363996e.slice/crio-14618aad2c722fe274daeb8222df7c9fd1c24a0b85804257e2e9adc45e4d736b WatchSource:0}: Error finding container 14618aad2c722fe274daeb8222df7c9fd1c24a0b85804257e2e9adc45e4d736b: Status 404 returned error can't find the container with id 14618aad2c722fe274daeb8222df7c9fd1c24a0b85804257e2e9adc45e4d736b
Jul 13 21:22:58.040615 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.040585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p5v8q"]
Jul 13 21:22:58.045406 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:58.045376    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45be4650_4057_4814_970b_7519a07c7e5a.slice/crio-194727772ab8b68363bd68508254332909bd424e9531a5f0146cd41e1114c099 WatchSource:0}: Error finding container 194727772ab8b68363bd68508254332909bd424e9531a5f0146cd41e1114c099: Status 404 returned error can't find the container with id 194727772ab8b68363bd68508254332909bd424e9531a5f0146cd41e1114c099
Jul 13 21:22:58.075797 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.075750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jtjk"]
Jul 13 21:22:58.080300 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:22:58.080271    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefbd6fe2_1f27_4373_9b76_e24eda507db6.slice/crio-1c2fef43d7433d2f1a0c287776e1b90ad4e145582906353fea7a09099b2af793 WatchSource:0}: Error finding container 1c2fef43d7433d2f1a0c287776e1b90ad4e145582906353fea7a09099b2af793: Status 404 returned error can't find the container with id 1c2fef43d7433d2f1a0c287776e1b90ad4e145582906353fea7a09099b2af793
Jul 13 21:22:58.520762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.520508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jtjk" event={"ID":"efbd6fe2-1f27-4373-9b76-e24eda507db6","Type":"ContainerStarted","Data":"1c2fef43d7433d2f1a0c287776e1b90ad4e145582906353fea7a09099b2af793"}
Jul 13 21:22:58.522692 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.522653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6" event={"ID":"9d0d54f9-7baa-426d-9897-3e48d363996e","Type":"ContainerStarted","Data":"33a015e3ae6f181a7909203fda87afb7d64dccc93d563e3ba8751a767fb11ad5"}
Jul 13 21:22:58.522878 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.522712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6" event={"ID":"9d0d54f9-7baa-426d-9897-3e48d363996e","Type":"ContainerStarted","Data":"14618aad2c722fe274daeb8222df7c9fd1c24a0b85804257e2e9adc45e4d736b"}
Jul 13 21:22:58.522878 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.522800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:22:58.524262 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.524234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p5v8q" event={"ID":"45be4650-4057-4814-970b-7519a07c7e5a","Type":"ContainerStarted","Data":"194727772ab8b68363bd68508254332909bd424e9531a5f0146cd41e1114c099"}
Jul 13 21:22:58.525334 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.525310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvr2b" event={"ID":"bed13a5b-934b-4a52-bafe-49050de274cc","Type":"ContainerStarted","Data":"dece58f2f91ed1d24f964adcda8242668bd8545660028d12e0c04c7f1fe66023"}
Jul 13 21:22:58.543751 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:58.543691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6" podStartSLOduration=7.543673233 podStartE2EDuration="7.543673233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:58.543051692 +0000 UTC m=+47.968000735" watchObservedRunningTime="2026-07-13 21:22:58.543673233 +0000 UTC m=+47.968622274"
Jul 13 21:22:59.164901 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.163874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:22:59.164901 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.164513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:22:59.164901 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.164501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:22:59.167736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.167134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 21:22:59.169530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.168041    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:22:59.169530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.168247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 21:22:59.169530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.168420    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:22:59.169530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.168638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk42z\""
Jul 13 21:22:59.169530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:22:59.168822    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r54dj\""
Jul 13 21:23:04.542611 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:04.542572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p5v8q" event={"ID":"45be4650-4057-4814-970b-7519a07c7e5a","Type":"ContainerStarted","Data":"97dcb1b9a1e0fd1c7ab1f299ffb2b779437de20194159788070f6274028efe92"}
Jul 13 21:23:04.544075 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:04.544052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvr2b" event={"ID":"bed13a5b-934b-4a52-bafe-49050de274cc","Type":"ContainerStarted","Data":"975ebe58773347bfed3934ad78b86834b1383c4ebd9c39a6676e289b973d1da3"}
Jul 13 21:23:04.561308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:04.561253    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p5v8q" podStartSLOduration=1.2503894469999999 podStartE2EDuration="7.561236794s" totalImagesPullingTime="6.310847347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:04.560152151 +0000 UTC m=+53.985101194" watchObservedRunningTime="2026-07-13 21:23:04.561236794 +0000 UTC m=+53.986185813"
Jul 13 21:23:05.550380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:05.550152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jtjk" event={"ID":"efbd6fe2-1f27-4373-9b76-e24eda507db6","Type":"ContainerStarted","Data":"f64adaca601fabd8730b51db6dd39a708710489747f0ed03116664bb72f9406f"}
Jul 13 21:23:05.552100 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:05.552077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvr2b" event={"ID":"bed13a5b-934b-4a52-bafe-49050de274cc","Type":"ContainerStarted","Data":"2f6c1b92d502bf586b44d03db4a43eca1f4005aec22ad81996cbe7fe4eace213"}
Jul 13 21:23:05.569617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:05.569574    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jvr2b" podStartSLOduration=2.231069952 podStartE2EDuration="8.5695577s" totalImagesPullingTime="6.338487748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:05.568300051 +0000 UTC m=+54.993249114" watchObservedRunningTime="2026-07-13 21:23:05.5695577 +0000 UTC m=+54.994506742"
Jul 13 21:23:06.558023 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:06.557978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jtjk" event={"ID":"efbd6fe2-1f27-4373-9b76-e24eda507db6","Type":"ContainerStarted","Data":"c02f8f43bdd31599aba224c17a3565b78a78ddaaf89c87a8c92f637c40149970"}
Jul 13 21:23:06.558477 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:06.558175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:23:08.569588 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:08.569503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jtjk" event={"ID":"efbd6fe2-1f27-4373-9b76-e24eda507db6","Type":"ContainerStarted","Data":"d10545a6e7410589ba3bb085e2e72cd346509208fd836b3592f65268cf7b02f7"}
Jul 13 21:23:08.586683 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:08.586634    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7jtjk" podStartSLOduration=1.658688509 podStartE2EDuration="11.586620492s" totalImagesPullingTime="9.927931983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:08.585459957 +0000 UTC m=+58.010409062" watchObservedRunningTime="2026-07-13 21:23:08.586620492 +0000 UTC m=+58.011569533"
Jul 13 21:23:11.127135 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.127105    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"]
Jul 13 21:23:11.130043 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.130021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.132711 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.132689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 21:23:11.132862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.132689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 21:23:11.132862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.132689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 21:23:11.133558 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.133534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 21:23:11.133691 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.133676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-z942w\""
Jul 13 21:23:11.133763 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.133694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 21:23:11.133763 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.133754    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 21:23:11.144699 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.144675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"]
Jul 13 21:23:11.147639 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.147616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjkm6"]
Jul 13 21:23:11.149698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.149674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.152414 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.152394    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 21:23:11.152534 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.152427    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 21:23:11.152598 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.152556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rcwv\""
Jul 13 21:23:11.152598 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.152555    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 21:23:11.182481 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.182481 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz5f4\" (UniqueName: \"kubernetes.io/projected/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-api-access-bz5f4\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.182764 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.182764 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.182764 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.182764 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.182679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.283625 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.283625 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-textfile\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz5f4\" (UniqueName: \"kubernetes.io/projected/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-api-access-bz5f4\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-sys\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-wtmp\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-root\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.283871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-metrics-client-ca\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.284122 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqr6\" (UniqueName: \"kubernetes.io/projected/65b846a6-f661-404b-a297-6de1c4b3c44a-kube-api-access-zkqr6\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.284122 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.284122 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.283961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.284122 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284122 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284358 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284358 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284358 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284358 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.284255    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 21:23:11.284358 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.284331    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls podName:4e2ead2f-97bf-447e-b3f1-1f6b122d9c10 nodeName:}" failed. No retries permitted until 2026-07-13 21:23:11.784310624 +0000 UTC m=+61.209259656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kpxpw" (UID: "4e2ead2f-97bf-447e-b3f1-1f6b122d9c10") : secret "kube-state-metrics-tls" not found
Jul 13 21:23:11.284819 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.284918 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.284875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.288342 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.288321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.295398 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.295371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz5f4\" (UniqueName: \"kubernetes.io/projected/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-api-access-bz5f4\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.385623 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-wtmp\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385623 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-root\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385623 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-metrics-client-ca\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-root\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-wtmp\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqr6\" (UniqueName: \"kubernetes.io/projected/65b846a6-f661-404b-a297-6de1c4b3c44a-kube-api-access-zkqr6\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.385882    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-textfile\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.385949 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.385946    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls podName:65b846a6-f661-404b-a297-6de1c4b3c44a nodeName:}" failed. No retries permitted until 2026-07-13 21:23:11.885924336 +0000 UTC m=+61.310873382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls") pod "node-exporter-bjkm6" (UID: "65b846a6-f661-404b-a297-6de1c4b3c44a") : secret "node-exporter-tls" not found
Jul 13 21:23:11.386429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.385976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-sys\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.386429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.386066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b846a6-f661-404b-a297-6de1c4b3c44a-sys\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.386429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.386252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-textfile\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.386429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.386329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-metrics-client-ca\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.386429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.386404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.388143 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.388126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.394360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.394328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqr6\" (UniqueName: \"kubernetes.io/projected/65b846a6-f661-404b-a297-6de1c4b3c44a-kube-api-access-zkqr6\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.789905 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.789806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:11.789905 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.789889    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 21:23:11.790101 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:23:11.789957    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls podName:4e2ead2f-97bf-447e-b3f1-1f6b122d9c10 nodeName:}" failed. No retries permitted until 2026-07-13 21:23:12.789942993 +0000 UTC m=+62.214892012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kpxpw" (UID: "4e2ead2f-97bf-447e-b3f1-1f6b122d9c10") : secret "kube-state-metrics-tls" not found
Jul 13 21:23:11.890713 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.890674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:11.893253 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:11.893223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b846a6-f661-404b-a297-6de1c4b3c44a-node-exporter-tls\") pod \"node-exporter-bjkm6\" (UID: \"65b846a6-f661-404b-a297-6de1c4b3c44a\") " pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:12.059363 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.059272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjkm6"
Jul 13 21:23:12.068824 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:12.068795    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b846a6_f661_404b_a297_6de1c4b3c44a.slice/crio-c8cb9074feb3230e92d9006ef2a811b891d29f139d4d08213f7d40646519e8fa WatchSource:0}: Error finding container c8cb9074feb3230e92d9006ef2a811b891d29f139d4d08213f7d40646519e8fa: Status 404 returned error can't find the container with id c8cb9074feb3230e92d9006ef2a811b891d29f139d4d08213f7d40646519e8fa
Jul 13 21:23:12.362463 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.360259    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:23:12.365663 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.365643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.368289 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 21:23:12.368462 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 21:23:12.368462 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kh2wb\""
Jul 13 21:23:12.368462 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 21:23:12.368624 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 21:23:12.368672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 21:23:12.368672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 21:23:12.368672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 21:23:12.368827 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368675    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 21:23:12.368827 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.368689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 21:23:12.377901 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.377880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:23:12.482024 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.481998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bdzr"
Jul 13 21:23:12.496726 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.496906 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.496906 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl9sh\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.496906 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.496991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497468 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.497468 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.497224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.584452 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.584390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkm6" event={"ID":"65b846a6-f661-404b-a297-6de1c4b3c44a","Type":"ContainerStarted","Data":"c8cb9074feb3230e92d9006ef2a811b891d29f139d4d08213f7d40646519e8fa"}
Jul 13 21:23:12.597855 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.597826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598003 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.597875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598003 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.597925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598003 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.597946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598003 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.597967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl9sh\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598483 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598483 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598483 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598483 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.598873 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.598848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.599891 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.599584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.601259 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.601237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.601489 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.601467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.601947 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.601924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.602076 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.601993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.602076 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.602038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.602195 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.602083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.602512 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.602484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.602626 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.602609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.603008 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.602987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.607919 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.607897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl9sh\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh\") pod \"alertmanager-main-0\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.674530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.674444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:23:12.799459 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.799429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:12.801742 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.801718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2ead2f-97bf-447e-b3f1-1f6b122d9c10-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kpxpw\" (UID: \"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:12.842524 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.842489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:23:12.938770 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:12.938683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"
Jul 13 21:23:13.086502 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:13.086459    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd86121_e84f_4d7b_ae49_623426c18175.slice/crio-98e39ad6120c481010154654f717f55f09345dbaec221712d4c969f4bb67e29a WatchSource:0}: Error finding container 98e39ad6120c481010154654f717f55f09345dbaec221712d4c969f4bb67e29a: Status 404 returned error can't find the container with id 98e39ad6120c481010154654f717f55f09345dbaec221712d4c969f4bb67e29a
Jul 13 21:23:13.209555 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.209479    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kpxpw"]
Jul 13 21:23:13.212350 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:13.212323    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2ead2f_97bf_447e_b3f1_1f6b122d9c10.slice/crio-6ab72de5e614a71db81fe45bbf5d69326080b9292f90137939c383387a041f2c WatchSource:0}: Error finding container 6ab72de5e614a71db81fe45bbf5d69326080b9292f90137939c383387a041f2c: Status 404 returned error can't find the container with id 6ab72de5e614a71db81fe45bbf5d69326080b9292f90137939c383387a041f2c
Jul 13 21:23:13.231518 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.231491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"]
Jul 13 21:23:13.245204 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.245169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.246200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.246173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"]
Jul 13 21:23:13.247838 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.247810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 21:23:13.247948 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.247818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 21:23:13.247948 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.247818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 21:23:13.247948 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.247826    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 21:23:13.248168 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.247918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3g2t63uo0gpga\""
Jul 13 21:23:13.248168 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.248028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fmg6h\""
Jul 13 21:23:13.248168 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.248063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 21:23:13.303147 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdncw\" (UniqueName: \"kubernetes.io/projected/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-kube-api-access-vdncw\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303469 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-grpc-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303469 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-metrics-client-ca\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.303469 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.303399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.404537 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-metrics-client-ca\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.404537 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdncw\" (UniqueName: \"kubernetes.io/projected/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-kube-api-access-vdncw\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.404916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-grpc-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.405461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.405427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-metrics-client-ca\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.407532 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.407503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.407773 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.407747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.407881 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.407752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.407881 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.407761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.407992 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.407915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.408245 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.408229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-secret-grpc-tls\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.412775 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.412756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdncw\" (UniqueName: \"kubernetes.io/projected/9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a-kube-api-access-vdncw\") pod \"thanos-querier-54f9b9fb79-dzn67\" (UID: \"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a\") " pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.555643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.555621    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:13.594433 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.594390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw" event={"ID":"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10","Type":"ContainerStarted","Data":"6ab72de5e614a71db81fe45bbf5d69326080b9292f90137939c383387a041f2c"}
Jul 13 21:23:13.595700 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.595678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"98e39ad6120c481010154654f717f55f09345dbaec221712d4c969f4bb67e29a"}
Jul 13 21:23:13.597369 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.597341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkm6" event={"ID":"65b846a6-f661-404b-a297-6de1c4b3c44a","Type":"ContainerStarted","Data":"f0dfcff1f659a8880deb07503464aaff596da6021d00977039841d1057cacf67"}
Jul 13 21:23:13.709643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:13.709612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"]
Jul 13 21:23:13.737777 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:13.737704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab7ed95_501d_47fd_b3f0_6bd1c90dc48a.slice/crio-5f048a17294d5f721e99adb6aca0e1f80d9c27b6e5f7c1061ccc64ef29d8864e WatchSource:0}: Error finding container 5f048a17294d5f721e99adb6aca0e1f80d9c27b6e5f7c1061ccc64ef29d8864e: Status 404 returned error can't find the container with id 5f048a17294d5f721e99adb6aca0e1f80d9c27b6e5f7c1061ccc64ef29d8864e
Jul 13 21:23:14.603429 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:14.603392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"5f048a17294d5f721e99adb6aca0e1f80d9c27b6e5f7c1061ccc64ef29d8864e"}
Jul 13 21:23:14.605071 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:14.605046    2565 generic.go:356] "Generic (PLEG): container finished" podID="65b846a6-f661-404b-a297-6de1c4b3c44a" containerID="f0dfcff1f659a8880deb07503464aaff596da6021d00977039841d1057cacf67" exitCode=0
Jul 13 21:23:14.605194 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:14.605104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkm6" event={"ID":"65b846a6-f661-404b-a297-6de1c4b3c44a","Type":"ContainerDied","Data":"f0dfcff1f659a8880deb07503464aaff596da6021d00977039841d1057cacf67"}
Jul 13 21:23:15.611909 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.611859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw" event={"ID":"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10","Type":"ContainerStarted","Data":"93e525cd33d920a6d9cc2dc0fb196b09f0f05d211edcc3e6e106cf1123c4f3fc"}
Jul 13 21:23:15.612399 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.611945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw" event={"ID":"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10","Type":"ContainerStarted","Data":"b62d4785ca0b1a32756250e29812cc9381ad892d13d5af521ca479a35a92d9e8"}
Jul 13 21:23:15.612399 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.611975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw" event={"ID":"4e2ead2f-97bf-447e-b3f1-1f6b122d9c10","Type":"ContainerStarted","Data":"e3e96a354e6f736339b0588c32c25647b62ec538d536c3fa676eabc6a3336275"}
Jul 13 21:23:15.614466 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.614435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkm6" event={"ID":"65b846a6-f661-404b-a297-6de1c4b3c44a","Type":"ContainerStarted","Data":"ff915d4cd9cd9309dc8e088dae8be48a31f1cb5d46c48f830a6a52d4f9ae950a"}
Jul 13 21:23:15.614626 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.614493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkm6" event={"ID":"65b846a6-f661-404b-a297-6de1c4b3c44a","Type":"ContainerStarted","Data":"756cfc721b6331a8cb242c9db9a1218a59adbe3a6d35ef025e07e694b35109c4"}
Jul 13 21:23:15.633323 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.633266    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-kpxpw" podStartSLOduration=3.152894315 podStartE2EDuration="4.633244842s" totalImagesPullingTime="1.480350527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:15.631655371 +0000 UTC m=+65.056604413" watchObservedRunningTime="2026-07-13 21:23:15.633244842 +0000 UTC m=+65.058193896"
Jul 13 21:23:15.650725 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:15.650673    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjkm6" podStartSLOduration=3.159732451 podStartE2EDuration="4.650655894s" totalImagesPullingTime="1.373551148s" totalInitContainerRuntime="117.372295ms" isStatefulPod=true podCreationTimestamp="2026-07-13 21:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:15.649432427 +0000 UTC m=+65.074381470" watchObservedRunningTime="2026-07-13 21:23:15.650655894 +0000 UTC m=+65.075604989"
Jul 13 21:23:16.565300 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.565266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jvr2b"
Jul 13 21:23:16.620857 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.620820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"61bc6c1e1f8e645baa77da6a78dac3524705b6ee0630ddaa31740b9c8f2bf09d"}
Jul 13 21:23:16.621312 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.620907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"395f0faf9d5832e4a3528193c0fb2c7696c49437558fcd8038a8d46d97e8956e"}
Jul 13 21:23:16.621312 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.620947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"a4811e9be3d926092f3e64bc4c1b34ea03b51ceb554d2bb3249da36e8d0558b7"}
Jul 13 21:23:16.839512 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.839429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:23:16.839512 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.839468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:23:16.841824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.841782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:23:16.842039 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.842028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:23:16.852347 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.852309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a57d9cf8-0780-4a6b-b71b-f0751418d02c-original-pull-secret\") pod \"global-pull-secret-syncer-wq8dc\" (UID: \"a57d9cf8-0780-4a6b-b71b-f0751418d02c\") " pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:23:16.852474 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.852320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d5a4f3-3b75-4241-808f-9768284406bf-metrics-certs\") pod \"network-metrics-daemon-zx5cr\" (UID: \"46d5a4f3-3b75-4241-808f-9768284406bf\") " pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:23:16.885086 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.885052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wq8dc"
Jul 13 21:23:16.896336 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.896313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk42z\""
Jul 13 21:23:16.904461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.904428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx5cr"
Jul 13 21:23:16.943566 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.941766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:23:16.945442 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.945406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 21:23:16.955715 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.955554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 21:23:16.967189 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:16.967125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nxp\" (UniqueName: \"kubernetes.io/projected/fdf2a9e1-c2df-475b-a33e-c205e276095d-kube-api-access-j5nxp\") pod \"network-check-target-srvr6\" (UID: \"fdf2a9e1-c2df-475b-a33e-c205e276095d\") " pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:23:17.038875 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.038841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wq8dc"]
Jul 13 21:23:17.063256 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.063224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx5cr"]
Jul 13 21:23:17.100136 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:17.100095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57d9cf8_0780_4a6b_b71b_f0751418d02c.slice/crio-0b607eb9bd471819c8088680eddb79fc4648a269804df462b056576bfd3ee2e7 WatchSource:0}: Error finding container 0b607eb9bd471819c8088680eddb79fc4648a269804df462b056576bfd3ee2e7: Status 404 returned error can't find the container with id 0b607eb9bd471819c8088680eddb79fc4648a269804df462b056576bfd3ee2e7
Jul 13 21:23:17.100758 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:17.100684    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d5a4f3_3b75_4241_808f_9768284406bf.slice/crio-32f0ee4a96a32cfb73efea0ee7e13dfa2570002be1c7e60e1f40d75a15dcc862 WatchSource:0}: Error finding container 32f0ee4a96a32cfb73efea0ee7e13dfa2570002be1c7e60e1f40d75a15dcc862: Status 404 returned error can't find the container with id 32f0ee4a96a32cfb73efea0ee7e13dfa2570002be1c7e60e1f40d75a15dcc862
Jul 13 21:23:17.203856 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.203832    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r54dj\""
Jul 13 21:23:17.212454 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.212434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:23:17.354937 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.354857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srvr6"]
Jul 13 21:23:17.358110 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:17.358087    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf2a9e1_c2df_475b_a33e_c205e276095d.slice/crio-a3c4dd426e56e6f5a9a61021f32568935773252b857ebd3de34dd966ca576796 WatchSource:0}: Error finding container a3c4dd426e56e6f5a9a61021f32568935773252b857ebd3de34dd966ca576796: Status 404 returned error can't find the container with id a3c4dd426e56e6f5a9a61021f32568935773252b857ebd3de34dd966ca576796
Jul 13 21:23:17.391470 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.391438    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:23:17.395196 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.395177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.397959 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.397938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 21:23:17.398083 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.397938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6427w\""
Jul 13 21:23:17.398083 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.397973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 21:23:17.398083 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.397937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 21:23:17.398083 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.397938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bqpl09lf4iu8\""
Jul 13 21:23:17.398549 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398531    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 21:23:17.398659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 21:23:17.398659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398566    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 21:23:17.398659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398613    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 21:23:17.398659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 21:23:17.398659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 21:23:17.398916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 21:23:17.398916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398848    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 21:23:17.399014 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.398917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 21:23:17.399087 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.399070    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 21:23:17.399282 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.399266    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 21:23:17.401731 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.401712    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 21:23:17.413920 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.413899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:23:17.547964 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.547924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.547991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548340 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5zr\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.548762 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.548712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.629447 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.629352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"d8e424ae8b2e476665278e475b7bc480c42957a14ac0efe4c3f5996d5eed57af"}
Jul 13 21:23:17.629900 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.629468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"92ff800d762d7da73ce38f748db4b0fcb46c288a20748619279e089dcbd1a61a"}
Jul 13 21:23:17.629900 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.629509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" event={"ID":"9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a","Type":"ContainerStarted","Data":"82329e9feb44bc2daf4b63d9669918287d861b67b63e92e9455e8ac3b433f8ab"}
Jul 13 21:23:17.629900 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.629706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:17.630952 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.630918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srvr6" event={"ID":"fdf2a9e1-c2df-475b-a33e-c205e276095d","Type":"ContainerStarted","Data":"a3c4dd426e56e6f5a9a61021f32568935773252b857ebd3de34dd966ca576796"}
Jul 13 21:23:17.632162 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.632133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx5cr" event={"ID":"46d5a4f3-3b75-4241-808f-9768284406bf","Type":"ContainerStarted","Data":"32f0ee4a96a32cfb73efea0ee7e13dfa2570002be1c7e60e1f40d75a15dcc862"}
Jul 13 21:23:17.633427 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.633400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wq8dc" event={"ID":"a57d9cf8-0780-4a6b-b71b-f0751418d02c","Type":"ContainerStarted","Data":"0b607eb9bd471819c8088680eddb79fc4648a269804df462b056576bfd3ee2e7"}
Jul 13 21:23:17.649879 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.649849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650002 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.649906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650002 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.649941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650002 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.649972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650002 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.649994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.650297 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5zr\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651886 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.650987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.651886 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.651271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.653010 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.652339    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67" podStartSLOduration=1.433468566 podStartE2EDuration="4.652321565s" totalImagesPullingTime="3.218852999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:17.650544734 +0000 UTC m=+67.075493780" watchObservedRunningTime="2026-07-13 21:23:17.652321565 +0000 UTC m=+67.077270607"
Jul 13 21:23:17.653010 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.652613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.653010 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.652910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.653228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.653189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.654322 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.654156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.654589 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.654564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.654801 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.654744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.655505 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.655459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.655777 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.655736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.656047 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.656018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.656155 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.656128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.656540 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.656518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.656732 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.656695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.656966 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.656903    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.657348 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.657316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.657632 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.657612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.658611 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.658590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.663333 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.663315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5zr\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr\") pod \"prometheus-k8s-0\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.705137 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.705098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:17.909456 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:17.909303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:23:17.916601 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:23:17.916560    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a66a196_661a_49cc_b99a_1bb9c1cf5824.slice/crio-3aef0ffcebbf92e78db36265449c586bb787183a800ac66c113792869fd48507 WatchSource:0}: Error finding container 3aef0ffcebbf92e78db36265449c586bb787183a800ac66c113792869fd48507: Status 404 returned error can't find the container with id 3aef0ffcebbf92e78db36265449c586bb787183a800ac66c113792869fd48507
Jul 13 21:23:18.642366 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:18.642263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx5cr" event={"ID":"46d5a4f3-3b75-4241-808f-9768284406bf","Type":"ContainerStarted","Data":"8f6889f8030081203d9272dcbed543320ac1b122ad20d413c39946644c88188d"}
Jul 13 21:23:18.646137 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:18.646098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"3aef0ffcebbf92e78db36265449c586bb787183a800ac66c113792869fd48507"}
Jul 13 21:23:19.534798 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.534754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df8554cf9-2d9s6"
Jul 13 21:23:19.652251 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.652212    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447" exitCode=0
Jul 13 21:23:19.652748 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.652299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447"}
Jul 13 21:23:19.654708 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.654678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx5cr" event={"ID":"46d5a4f3-3b75-4241-808f-9768284406bf","Type":"ContainerStarted","Data":"01f0046813da35ca5e1c1ecfafa26b588085fd98a4f7f928360efe2b618f9839"}
Jul 13 21:23:19.656586 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.656564    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="bb84e4a77dc28b161b3d92c2407b23e8501fb21c367efa92df47a8ec728d9ec8" exitCode=0
Jul 13 21:23:19.656694 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.656613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"bb84e4a77dc28b161b3d92c2407b23e8501fb21c367efa92df47a8ec728d9ec8"}
Jul 13 21:23:19.722187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:19.722122    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zx5cr" podStartSLOduration=67.355602498 podStartE2EDuration="1m8.722104259s" totalImagesPullingTime="1.366501761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:19.721081085 +0000 UTC m=+69.146030126" watchObservedRunningTime="2026-07-13 21:23:19.722104259 +0000 UTC m=+69.147053303"
Jul 13 21:23:22.672496 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:22.672463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srvr6" event={"ID":"fdf2a9e1-c2df-475b-a33e-c205e276095d","Type":"ContainerStarted","Data":"3def537bdc8030ae06bb772293195c985ab163ef041059a15faef5c359466897"}
Jul 13 21:23:22.672959 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:22.672581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:23:22.691640 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:22.691515    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-srvr6" podStartSLOduration=65.487137705 podStartE2EDuration="1m10.691492993s" totalImagesPullingTime="5.204355288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:22.690615516 +0000 UTC m=+72.115564571" watchObservedRunningTime="2026-07-13 21:23:22.691492993 +0000 UTC m=+72.116442039"
Jul 13 21:23:23.652887 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.652863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54f9b9fb79-dzn67"
Jul 13 21:23:23.677852 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.677817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wq8dc" event={"ID":"a57d9cf8-0780-4a6b-b71b-f0751418d02c","Type":"ContainerStarted","Data":"a931fcadd6a6b1ba0335d1dd928f1afca507414d708eab32968d21dbc6262c42"}
Jul 13 21:23:23.682308 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"}
Jul 13 21:23:23.682460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"}
Jul 13 21:23:23.682460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"}
Jul 13 21:23:23.682460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"}
Jul 13 21:23:23.682593 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"}
Jul 13 21:23:23.682593 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.682526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerStarted","Data":"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"}
Jul 13 21:23:23.697943 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.697846    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wq8dc" podStartSLOduration=66.230592716 podStartE2EDuration="1m11.697822672s" totalImagesPullingTime="5.467229956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:23.697649518 +0000 UTC m=+73.122598572" watchObservedRunningTime="2026-07-13 21:23:23.697822672 +0000 UTC m=+73.122771714"
Jul 13 21:23:23.735646 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:23.735585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.52394131 podStartE2EDuration="11.735561019s" totalImagesPullingTime="9.192494022s" totalInitContainerRuntime="19.125687ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:23.733042036 +0000 UTC m=+73.157991069" watchObservedRunningTime="2026-07-13 21:23:23.735561019 +0000 UTC m=+73.160510061"
Jul 13 21:23:25.694236 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:25.694203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"1202372a68613c10628775c5bc8389d4dabc924b0811beac7b9a288dfda4e365"}
Jul 13 21:23:26.701098 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.701061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"f77eb400b72966e60f131f89cce36b3eba6ce967c52f5f3b9dce822a5d43d556"}
Jul 13 21:23:26.701490 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.701126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"ccee5c54888e027f8906d9ac9f4d2cb4d86801fae87f51e0fc83aab3940cb2b9"}
Jul 13 21:23:26.701490 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.701167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"070052c5cebc6f3ce5c2616d763d9797b73e29cb16adbbac270643802afffc9b"}
Jul 13 21:23:26.701490 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.701198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"e477b62dcd76f3e97ce0c9a55919212848a41776b65d5f75d77de6fc7217424f"}
Jul 13 21:23:26.701490 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.701221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerStarted","Data":"1875667cbc55dd283a8ade1d960a4a7eab36b1350a66eb718592e037ab9e8b4c"}
Jul 13 21:23:26.729361 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:26.729300    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.402012276 podStartE2EDuration="9.729280279s" totalImagesPullingTime="7.304536394s" totalInitContainerRuntime="22.731609ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:26.72757111 +0000 UTC m=+76.152520151" watchObservedRunningTime="2026-07-13 21:23:26.729280279 +0000 UTC m=+76.154229321"
Jul 13 21:23:27.705248 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:27.705217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:23:41.883106 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:41.882969    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p5v8q_45be4650-4057-4814-970b-7519a07c7e5a/serve-healthcheck-canary/0.log"
Jul 13 21:23:53.685600 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:23:53.685569    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-srvr6"
Jul 13 21:24:17.705985 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:17.705948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:17.725312 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:17.725284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:17.908671 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:17.908640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:31.580191 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580151    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:24:31.580678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580520    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="alertmanager" containerID="cri-o://5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e" gracePeriod=120
Jul 13 21:24:31.580678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580570    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-metric" containerID="cri-o://24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f" gracePeriod=120
Jul 13 21:24:31.580678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580602    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-web" containerID="cri-o://42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9" gracePeriod=120
Jul 13 21:24:31.580678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580628    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="config-reloader" containerID="cri-o://8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184" gracePeriod=120
Jul 13 21:24:31.580678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580649    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="prom-label-proxy" containerID="cri-o://81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a" gracePeriod=120
Jul 13 21:24:31.580963 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.580667    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy" containerID="cri-o://66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3" gracePeriod=120
Jul 13 21:24:31.948736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948703    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a" exitCode=0
Jul 13 21:24:31.948736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948728    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f" exitCode=0
Jul 13 21:24:31.948736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948734    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3" exitCode=0
Jul 13 21:24:31.948736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948741    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184" exitCode=0
Jul 13 21:24:31.948736 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948748    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e" exitCode=0
Jul 13 21:24:31.949041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"}
Jul 13 21:24:31.949041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"}
Jul 13 21:24:31.949041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"}
Jul 13 21:24:31.949041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"}
Jul 13 21:24:31.949041 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:31.948951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"}
Jul 13 21:24:32.831618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.831590    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:24:32.889053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889229 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889229 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889229 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889229 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889433 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889334    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889433 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889535 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889452    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889535 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889639 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889639 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl9sh\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889639 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.889804 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:32.889804 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889649    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web\") pod \"bbd86121-e84f-4d7b-ae49-623426c18175\" (UID: \"bbd86121-e84f-4d7b-ae49-623426c18175\") "
Jul 13 21:24:32.890190 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.889935    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.890992 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.890960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:24:32.891200 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.891174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:32.892088 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume" (OuterVolumeSpecName: "config-volume") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.892226 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.892381 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892334    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.892675 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892537    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:24:32.892675 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892598    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.892954 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.892925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh" (OuterVolumeSpecName: "kube-api-access-pl9sh") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "kube-api-access-pl9sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:24:32.894858 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.894825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out" (OuterVolumeSpecName: "config-out") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:24:32.894989 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.894967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.899103 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.899044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.905514 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.905485    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config" (OuterVolumeSpecName: "web-config") pod "bbd86121-e84f-4d7b-ae49-623426c18175" (UID: "bbd86121-e84f-4d7b-ae49-623426c18175"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:32.956462 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.956426    2565 generic.go:356] "Generic (PLEG): container finished" podID="bbd86121-e84f-4d7b-ae49-623426c18175" containerID="42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9" exitCode=0
Jul 13 21:24:32.956628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.956500    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 21:24:32.956628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.956509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"}
Jul 13 21:24:32.956628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.956579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbd86121-e84f-4d7b-ae49-623426c18175","Type":"ContainerDied","Data":"98e39ad6120c481010154654f717f55f09345dbaec221712d4c969f4bb67e29a"}
Jul 13 21:24:32.956628 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.956613    2565 scope.go:117] "RemoveContainer" containerID="81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"
Jul 13 21:24:32.965513 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.965492    2565 scope.go:117] "RemoveContainer" containerID="24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"
Jul 13 21:24:32.974671 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.974648    2565 scope.go:117] "RemoveContainer" containerID="66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"
Jul 13 21:24:32.980098 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.980072    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:24:32.984039 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.984015    2565 scope.go:117] "RemoveContainer" containerID="42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"
Jul 13 21:24:32.984294 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.984276    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 21:24:32.990407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990379    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-config-volume\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990401    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-cluster-tls-config\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990410    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-config-out\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990420    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-web-config\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990430    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990441    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd86121-e84f-4d7b-ae49-623426c18175-alertmanager-main-db\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990449    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl9sh\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-kube-api-access-pl9sh\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990459    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86121-e84f-4d7b-ae49-623426c18175-metrics-client-ca\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990467    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990476    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-main-tls\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990495    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbd86121-e84f-4d7b-ae49-623426c18175-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.990597 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.990505    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd86121-e84f-4d7b-ae49-623426c18175-tls-assets\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:32.991137 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.991123    2565 scope.go:117] "RemoveContainer" containerID="8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"
Jul 13 21:24:32.998933 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:32.998869    2565 scope.go:117] "RemoveContainer" containerID="5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"
Jul 13 21:24:33.007270 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.007246    2565 scope.go:117] "RemoveContainer" containerID="d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447"
Jul 13 21:24:33.014776 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.014756    2565 scope.go:117] "RemoveContainer" containerID="81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"
Jul 13 21:24:33.015111 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.015086    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a\": container with ID starting with 81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a not found: ID does not exist" containerID="81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"
Jul 13 21:24:33.015160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015122    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a"} err="failed to get container status \"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a\": rpc error: code = NotFound desc = could not find container \"81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a\": container with ID starting with 81647c28e68994e39496df0d5ae54109af7d56bc5e965864faaa1df3d102fe7a not found: ID does not exist"
Jul 13 21:24:33.015160 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015154    2565 scope.go:117] "RemoveContainer" containerID="24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"
Jul 13 21:24:33.015370 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.015355    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f\": container with ID starting with 24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f not found: ID does not exist" containerID="24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"
Jul 13 21:24:33.015408 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015374    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f"} err="failed to get container status \"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f\": rpc error: code = NotFound desc = could not find container \"24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f\": container with ID starting with 24a877820b2950d93cbede6f362b27910eb38dff63d04a64c07aae5598c7192f not found: ID does not exist"
Jul 13 21:24:33.015408 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015389    2565 scope.go:117] "RemoveContainer" containerID="66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"
Jul 13 21:24:33.015649 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.015629    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3\": container with ID starting with 66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3 not found: ID does not exist" containerID="66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"
Jul 13 21:24:33.015686 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015659    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3"} err="failed to get container status \"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3\": rpc error: code = NotFound desc = could not find container \"66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3\": container with ID starting with 66d0d66dcc99d544096d4db0d5c43b67156f0c8da6f6ea4091147950a68877b3 not found: ID does not exist"
Jul 13 21:24:33.015686 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015679    2565 scope.go:117] "RemoveContainer" containerID="42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"
Jul 13 21:24:33.015949 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.015929    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9\": container with ID starting with 42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9 not found: ID does not exist" containerID="42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"
Jul 13 21:24:33.015990 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9"} err="failed to get container status \"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9\": rpc error: code = NotFound desc = could not find container \"42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9\": container with ID starting with 42313c93c80c988339cd0da79c48d8caae31be9849a37794e0386e24bb1cc8f9 not found: ID does not exist"
Jul 13 21:24:33.015990 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.015973    2565 scope.go:117] "RemoveContainer" containerID="8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"
Jul 13 21:24:33.016180 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.016157    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184\": container with ID starting with 8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184 not found: ID does not exist" containerID="8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"
Jul 13 21:24:33.016214 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.016183    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184"} err="failed to get container status \"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184\": rpc error: code = NotFound desc = could not find container \"8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184\": container with ID starting with 8d1b13831d746c14aa0f3006498c4a67ee4628ddce51dd93d983872468bbb184 not found: ID does not exist"
Jul 13 21:24:33.016214 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.016194    2565 scope.go:117] "RemoveContainer" containerID="5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"
Jul 13 21:24:33.016438 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.016422    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e\": container with ID starting with 5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e not found: ID does not exist" containerID="5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"
Jul 13 21:24:33.016480 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.016442    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e"} err="failed to get container status \"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e\": rpc error: code = NotFound desc = could not find container \"5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e\": container with ID starting with 5190956f124407b18e156397fb4380f61a7a5fe1ceff9d5d0549bd8d8f1ed85e not found: ID does not exist"
Jul 13 21:24:33.016480 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.016457    2565 scope.go:117] "RemoveContainer" containerID="d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447"
Jul 13 21:24:33.016689 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:24:33.016670    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447\": container with ID starting with d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447 not found: ID does not exist" containerID="d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447"
Jul 13 21:24:33.016742 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.016700    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447"} err="failed to get container status \"d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447\": rpc error: code = NotFound desc = could not find container \"d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447\": container with ID starting with d60e5a661d00d394fb11adaa3068e822aa91cacbde1fed949081e9c07323a447 not found: ID does not exist"
Jul 13 21:24:33.168904 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:33.168826    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" path="/var/lib/kubelet/pods/bbd86121-e84f-4d7b-ae49-623426c18175/volumes"
Jul 13 21:24:35.820991 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.820953    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:35.821460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821362    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="prometheus" containerID="cri-o://1202372a68613c10628775c5bc8389d4dabc924b0811beac7b9a288dfda4e365" gracePeriod=600
Jul 13 21:24:35.821460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821398    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="thanos-sidecar" containerID="cri-o://e477b62dcd76f3e97ce0c9a55919212848a41776b65d5f75d77de6fc7217424f" gracePeriod=600
Jul 13 21:24:35.821460 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821420    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f77eb400b72966e60f131f89cce36b3eba6ce967c52f5f3b9dce822a5d43d556" gracePeriod=600
Jul 13 21:24:35.821643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821395    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-web" containerID="cri-o://070052c5cebc6f3ce5c2616d763d9797b73e29cb16adbbac270643802afffc9b" gracePeriod=600
Jul 13 21:24:35.821643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821395    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="config-reloader" containerID="cri-o://1875667cbc55dd283a8ade1d960a4a7eab36b1350a66eb718592e037ab9e8b4c" gracePeriod=600
Jul 13 21:24:35.821643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.821430    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy" containerID="cri-o://ccee5c54888e027f8906d9ac9f4d2cb4d86801fae87f51e0fc83aab3940cb2b9" gracePeriod=600
Jul 13 21:24:35.972355 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972320    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="f77eb400b72966e60f131f89cce36b3eba6ce967c52f5f3b9dce822a5d43d556" exitCode=0
Jul 13 21:24:35.972355 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972351    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="ccee5c54888e027f8906d9ac9f4d2cb4d86801fae87f51e0fc83aab3940cb2b9" exitCode=0
Jul 13 21:24:35.972355 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972361    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="070052c5cebc6f3ce5c2616d763d9797b73e29cb16adbbac270643802afffc9b" exitCode=0
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972372    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="e477b62dcd76f3e97ce0c9a55919212848a41776b65d5f75d77de6fc7217424f" exitCode=0
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972380    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="1875667cbc55dd283a8ade1d960a4a7eab36b1350a66eb718592e037ab9e8b4c" exitCode=0
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972388    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerID="1202372a68613c10628775c5bc8389d4dabc924b0811beac7b9a288dfda4e365" exitCode=0
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"f77eb400b72966e60f131f89cce36b3eba6ce967c52f5f3b9dce822a5d43d556"}
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"ccee5c54888e027f8906d9ac9f4d2cb4d86801fae87f51e0fc83aab3940cb2b9"}
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"070052c5cebc6f3ce5c2616d763d9797b73e29cb16adbbac270643802afffc9b"}
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"e477b62dcd76f3e97ce0c9a55919212848a41776b65d5f75d77de6fc7217424f"}
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"1875667cbc55dd283a8ade1d960a4a7eab36b1350a66eb718592e037ab9e8b4c"}
Jul 13 21:24:35.972647 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:35.972622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"1202372a68613c10628775c5bc8389d4dabc924b0811beac7b9a288dfda4e365"}
Jul 13 21:24:36.063856 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.063829    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:36.114438 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114409    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114615 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114615 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114615 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114737    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.114814 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.115109 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114825    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs5zr\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.115109 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.115109 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.114888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115429    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115457    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115486    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config\") pod \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\" (UID: \"0a66a196-661a-49cc-b99a-1bb9c1cf5824\") "
Jul 13 21:24:36.116069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.115839    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.116648 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.116266    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.116906 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.116877    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.117520 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.117086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.117520 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.117338    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.117710 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.117517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.117710 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.117691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.117911 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.117745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:36.118553 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.118083    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out" (OuterVolumeSpecName: "config-out") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:24:36.118553 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.118190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:24:36.118553 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.118391    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:24:36.118553 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.118523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.119714 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.119685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config" (OuterVolumeSpecName: "config") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.120117 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.120083    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.120269 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.120140    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.120269 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.120208    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.120383 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.120291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.120513 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.120497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr" (OuterVolumeSpecName: "kube-api-access-hs5zr") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "kube-api-access-hs5zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:24:36.121345 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.121328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.128726 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.128701    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config" (OuterVolumeSpecName: "web-config") pod "0a66a196-661a-49cc-b99a-1bb9c1cf5824" (UID: "0a66a196-661a-49cc-b99a-1bb9c1cf5824"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:36.216177 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216141    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-metrics-client-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216177 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216171    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216177 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216182    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216192    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-metrics-client-ca\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216202    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-web-config\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216212    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216221    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-kube-rbac-proxy\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216229    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-tls-assets\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216237    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216244    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-grpc-tls\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216252    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216264    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216275    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216283    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a66a196-661a-49cc-b99a-1bb9c1cf5824-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216290    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs5zr\" (UniqueName: \"kubernetes.io/projected/0a66a196-661a-49cc-b99a-1bb9c1cf5824-kube-api-access-hs5zr\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216298    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216306    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-config-out\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216313    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a66a196-661a-49cc-b99a-1bb9c1cf5824-prometheus-k8s-db\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.216402 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.216320    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a66a196-661a-49cc-b99a-1bb9c1cf5824-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:24:36.979398 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.979364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a66a196-661a-49cc-b99a-1bb9c1cf5824","Type":"ContainerDied","Data":"3aef0ffcebbf92e78db36265449c586bb787183a800ac66c113792869fd48507"}
Jul 13 21:24:36.979746 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.979418    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:36.979746 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.979445    2565 scope.go:117] "RemoveContainer" containerID="f77eb400b72966e60f131f89cce36b3eba6ce967c52f5f3b9dce822a5d43d556"
Jul 13 21:24:36.987820 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.987796    2565 scope.go:117] "RemoveContainer" containerID="ccee5c54888e027f8906d9ac9f4d2cb4d86801fae87f51e0fc83aab3940cb2b9"
Jul 13 21:24:36.994820 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:36.994802    2565 scope.go:117] "RemoveContainer" containerID="070052c5cebc6f3ce5c2616d763d9797b73e29cb16adbbac270643802afffc9b"
Jul 13 21:24:37.001352 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.001323    2565 scope.go:117] "RemoveContainer" containerID="e477b62dcd76f3e97ce0c9a55919212848a41776b65d5f75d77de6fc7217424f"
Jul 13 21:24:37.002920 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.002898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:37.007649 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.007628    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:37.009292 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.009273    2565 scope.go:117] "RemoveContainer" containerID="1875667cbc55dd283a8ade1d960a4a7eab36b1350a66eb718592e037ab9e8b4c"
Jul 13 21:24:37.016172 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.016154    2565 scope.go:117] "RemoveContainer" containerID="1202372a68613c10628775c5bc8389d4dabc924b0811beac7b9a288dfda4e365"
Jul 13 21:24:37.023239 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.023214    2565 scope.go:117] "RemoveContainer" containerID="bb84e4a77dc28b161b3d92c2407b23e8501fb21c367efa92df47a8ec728d9ec8"
Jul 13 21:24:37.033330 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033304    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:37.033543 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033532    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033545    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033557    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="prom-label-proxy"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033562    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="prom-label-proxy"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033568    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-thanos"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033573    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-thanos"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033580    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="init-config-reloader"
Jul 13 21:24:37.033584 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033585    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="init-config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033590    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033604    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="prometheus"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033609    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="prometheus"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033616    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033622    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033627    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033632    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033639    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="alertmanager"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033644    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="alertmanager"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033650    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="init-config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="init-config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033662    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033667    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033672    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-metric"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033677    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-metric"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033683    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="thanos-sidecar"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033688    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="thanos-sidecar"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033696    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033737    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="prom-label-proxy"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="alertmanager"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033751    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033756    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033763    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="thanos-sidecar"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033768    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="prometheus"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033773    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033778    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="config-reloader"
Jul 13 21:24:37.033782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-web"
Jul 13 21:24:37.034550 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033810    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" containerName="kube-rbac-proxy-thanos"
Jul 13 21:24:37.034550 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy"
Jul 13 21:24:37.034550 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.033820    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86121-e84f-4d7b-ae49-623426c18175" containerName="kube-rbac-proxy-metric"
Jul 13 21:24:37.037489 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.037471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.039780 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.039755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 21:24:37.039868 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.039759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 21:24:37.039912 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.039863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bqpl09lf4iu8\""
Jul 13 21:24:37.040081 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040068    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 21:24:37.040121 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 21:24:37.040303 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 21:24:37.040381 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 21:24:37.040436 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040419    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 21:24:37.040658 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.040644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 21:24:37.041225 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041210    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 21:24:37.041379 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041364    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6427w\""
Jul 13 21:24:37.041722 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 21:24:37.041722 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041624    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 21:24:37.041722 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041618    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 21:24:37.041722 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.041624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 21:24:37.044331 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.044312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 21:24:37.046863 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.046846    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 21:24:37.054089 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.054068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:37.121833 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.121996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.121996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.121996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p22gg\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-kube-api-access-p22gg\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.121996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.121996 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.121998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122161 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.122360 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.122292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.171093 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.168449    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a66a196-661a-49cc-b99a-1bb9c1cf5824" path="/var/lib/kubelet/pods/0a66a196-661a-49cc-b99a-1bb9c1cf5824/volumes"
Jul 13 21:24:37.223556 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.223720 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p22gg\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-kube-api-access-p22gg\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.223998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224650 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224650 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224650 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.224650 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.224446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.225069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.225045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.225560 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.225537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.226779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.226852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.226941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.226951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227941 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.227404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227941 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.227669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.227941 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.227761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.228150 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.228128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.228241 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.228216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.228393 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.228373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.228470 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.228450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.229290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.229261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-config\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.229865 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.229844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.229947 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.229913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.230363 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.230346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.235116 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.235095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p22gg\" (UniqueName: \"kubernetes.io/projected/4ffa70d4-24b6-4b05-8792-d7b4cb3f962e-kube-api-access-p22gg\") pod \"prometheus-k8s-0\" (UID: \"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.348617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.348573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:24:37.482806 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.482760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 21:24:37.485178 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:24:37.485150    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffa70d4_24b6_4b05_8792_d7b4cb3f962e.slice/crio-40dc5654d6654cffbc433348dfa96647fc71e9d1bdfefaaf758078dd3c726e83 WatchSource:0}: Error finding container 40dc5654d6654cffbc433348dfa96647fc71e9d1bdfefaaf758078dd3c726e83: Status 404 returned error can't find the container with id 40dc5654d6654cffbc433348dfa96647fc71e9d1bdfefaaf758078dd3c726e83
Jul 13 21:24:37.986190 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.986152    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ffa70d4-24b6-4b05-8792-d7b4cb3f962e" containerID="515452a8c4626cdff349abb63fff89e6e6ca463d0444910304a9e8c127b0bd26" exitCode=0
Jul 13 21:24:37.986579 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.986198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerDied","Data":"515452a8c4626cdff349abb63fff89e6e6ca463d0444910304a9e8c127b0bd26"}
Jul 13 21:24:37.986579 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:37.986255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"40dc5654d6654cffbc433348dfa96647fc71e9d1bdfefaaf758078dd3c726e83"}
Jul 13 21:24:38.993664 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"44eaa79d81ceeb44b4d15bcb9834418d4d37131a8d97177294f5ea086541ae8e"}
Jul 13 21:24:38.994061 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"901b347763c44cb24579d8745a96b56a68ce562f60a7bc13615131cac9d0da11"}
Jul 13 21:24:38.994061 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"6ca81a0165f28d9ef01b79c7a94ebd7dcbeb1904758eeaf9ef879537aa9baf0a"}
Jul 13 21:24:38.994061 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"8f021f26b035bf20b4fb64ee934d2b5e2d8d529f9e954809afcb8b358e77e8e9"}
Jul 13 21:24:38.994061 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"d716c92499ae5733a000b2155d7b6b29e8487fffc40a0a4211ab72b88aa54b40"}
Jul 13 21:24:38.994061 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:38.993838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ffa70d4-24b6-4b05-8792-d7b4cb3f962e","Type":"ContainerStarted","Data":"9e05d0d679117e111232c68ec10f6ba8c9e553bd2693a8c4fd853ebc35410e22"}
Jul 13 21:24:39.020723 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:39.020611    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.997675686 podStartE2EDuration="2.020589829s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.914143ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:24:39.018131802 +0000 UTC m=+148.443080855" watchObservedRunningTime="2026-07-13 21:24:39.020589829 +0000 UTC m=+148.445538875"
Jul 13 21:24:42.348889 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:24:42.348837    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:25:37.349075 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:37.349033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:25:37.364464 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:37.364437    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:25:38.227863 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:38.227807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 21:25:57.396561 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.396530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"]
Jul 13 21:25:57.400176 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.400158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.403440 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.403396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 21:25:57.403572 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.403532    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:25:57.403659 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.403642    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kbnh2\""
Jul 13 21:25:57.414574 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.414547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"]
Jul 13 21:25:57.483963 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.483924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzb9j\" (UniqueName: \"kubernetes.io/projected/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-kube-api-access-vzb9j\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.483963 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.483961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.584678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.584642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzb9j\" (UniqueName: \"kubernetes.io/projected/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-kube-api-access-vzb9j\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.584678 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.584678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.585045 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.585020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.597148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.597124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzb9j\" (UniqueName: \"kubernetes.io/projected/c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c-kube-api-access-vzb9j\") pod \"openshift-lws-operator-fd8ccff4c-x54f4\" (UID: \"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.727310 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.727214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"
Jul 13 21:25:57.882115 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:57.882076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4"]
Jul 13 21:25:57.888255 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:25:57.888225    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2b9b0b1_4f18_44c5_950a_0ccc19e8c78c.slice/crio-55a6af4fa33cb9b55461b9def73289d12438a51aa81c541d61781af953bd1b6b WatchSource:0}: Error finding container 55a6af4fa33cb9b55461b9def73289d12438a51aa81c541d61781af953bd1b6b: Status 404 returned error can't find the container with id 55a6af4fa33cb9b55461b9def73289d12438a51aa81c541d61781af953bd1b6b
Jul 13 21:25:58.283568 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:25:58.283535    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4" event={"ID":"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c","Type":"ContainerStarted","Data":"55a6af4fa33cb9b55461b9def73289d12438a51aa81c541d61781af953bd1b6b"}
Jul 13 21:26:01.296782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:01.296743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4" event={"ID":"c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c","Type":"ContainerStarted","Data":"7c98207ef677dc21dbab7ac3749ba6e2882a94e6c8756a5209d64b78d3147455"}
Jul 13 21:26:01.316674 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:01.316606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x54f4" podStartSLOduration=1.850344132 podStartE2EDuration="4.316584647s" totalImagesPullingTime="2.466240515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:01.315925866 +0000 UTC m=+230.740874909" watchObservedRunningTime="2026-07-13 21:26:01.316584647 +0000 UTC m=+230.741533689"
Jul 13 21:26:16.705535 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.705498    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"]
Jul 13 21:26:16.708932 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.708905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.710981 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.710955    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 21:26:16.711175 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.711159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 21:26:16.711290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.711245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 21:26:16.711479 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.711457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 21:26:16.711479 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.711473    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lnw2r\""
Jul 13 21:26:16.725768 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.725741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"]
Jul 13 21:26:16.844698 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.844665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.844907 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.844716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.844907 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.844740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.844907 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.844865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.844907 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.844893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s4z\" (UniqueName: \"kubernetes.io/projected/400afb64-3517-43ab-baff-efd22155a74f-kube-api-access-w5s4z\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s4z\" (UniqueName: \"kubernetes.io/projected/400afb64-3517-43ab-baff-efd22155a74f-kube-api-access-w5s4z\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946187 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946633 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946633 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946633 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.946921 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.946900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.948665 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.948637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400afb64-3517-43ab-baff-efd22155a74f-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.948758 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.948697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.948758 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.948728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/400afb64-3517-43ab-baff-efd22155a74f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:16.954731 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:16.954707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s4z\" (UniqueName: \"kubernetes.io/projected/400afb64-3517-43ab-baff-efd22155a74f-kube-api-access-w5s4z\") pod \"opendatahub-operator-controller-manager-6f98b9f4-hn4qq\" (UID: \"400afb64-3517-43ab-baff-efd22155a74f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:17.019644 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:17.019549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:17.155615 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:17.155588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"]
Jul 13 21:26:17.157821 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:26:17.157770    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400afb64_3517_43ab_baff_efd22155a74f.slice/crio-b643b49357160017a40a355efb70a835312d37241cb6499907641d20ac2c85c3 WatchSource:0}: Error finding container b643b49357160017a40a355efb70a835312d37241cb6499907641d20ac2c85c3: Status 404 returned error can't find the container with id b643b49357160017a40a355efb70a835312d37241cb6499907641d20ac2c85c3
Jul 13 21:26:17.354586 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:17.354549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq" event={"ID":"400afb64-3517-43ab-baff-efd22155a74f","Type":"ContainerStarted","Data":"b643b49357160017a40a355efb70a835312d37241cb6499907641d20ac2c85c3"}
Jul 13 21:26:20.369595 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:20.369558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq" event={"ID":"400afb64-3517-43ab-baff-efd22155a74f","Type":"ContainerStarted","Data":"31dcfa7bc0a4c3d1696ad2e48258d610b78483e8b444a03b92f7356873d428bb"}
Jul 13 21:26:22.377998 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:22.377961    2565 generic.go:356] "Generic (PLEG): container finished" podID="400afb64-3517-43ab-baff-efd22155a74f" containerID="31dcfa7bc0a4c3d1696ad2e48258d610b78483e8b444a03b92f7356873d428bb" exitCode=0
Jul 13 21:26:22.378392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:22.378027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq" event={"ID":"400afb64-3517-43ab-baff-efd22155a74f","Type":"ContainerDied","Data":"31dcfa7bc0a4c3d1696ad2e48258d610b78483e8b444a03b92f7356873d428bb"}
Jul 13 21:26:23.384634 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:23.384596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq" event={"ID":"400afb64-3517-43ab-baff-efd22155a74f","Type":"ContainerStarted","Data":"bfaa69c05a57ef48d98a335de05a0018b1534237d3c2d23291a9cc59c525c89a"}
Jul 13 21:26:23.385134 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:23.384930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:23.407395 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:23.407332    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq" podStartSLOduration=2.729142415 podStartE2EDuration="7.407313318s" totalImagesPullingTime="3.51370332s" totalInitContainerRuntime="1.164467583s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:23.405191911 +0000 UTC m=+252.830140963" watchObservedRunningTime="2026-07-13 21:26:23.407313318 +0000 UTC m=+252.832262358"
Jul 13 21:26:34.391486 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:34.391416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-hn4qq"
Jul 13 21:26:41.916072 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.916036    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"]
Jul 13 21:26:41.923450 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.923420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:41.925918 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.925889    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 21:26:41.926799 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.926767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 21:26:41.926898 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.926775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 21:26:41.926898 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.926869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zckn2\""
Jul 13 21:26:41.926978 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.926869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 21:26:41.930999 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.930974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"]
Jul 13 21:26:41.934672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.934650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8125f7-82f3-4401-81e0-8dfa282263c9-tls-certs\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:41.934766 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.934679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mrnm\" (UniqueName: \"kubernetes.io/projected/da8125f7-82f3-4401-81e0-8dfa282263c9-kube-api-access-7mrnm\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:41.934766 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:41.934710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8125f7-82f3-4401-81e0-8dfa282263c9-tmp\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.035778 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.035736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8125f7-82f3-4401-81e0-8dfa282263c9-tls-certs\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.035778 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.035780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mrnm\" (UniqueName: \"kubernetes.io/projected/da8125f7-82f3-4401-81e0-8dfa282263c9-kube-api-access-7mrnm\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.036015 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.035851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8125f7-82f3-4401-81e0-8dfa282263c9-tmp\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.038175 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.038153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8125f7-82f3-4401-81e0-8dfa282263c9-tmp\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.038407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.038388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8125f7-82f3-4401-81e0-8dfa282263c9-tls-certs\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.043747 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.043716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mrnm\" (UniqueName: \"kubernetes.io/projected/da8125f7-82f3-4401-81e0-8dfa282263c9-kube-api-access-7mrnm\") pod \"kube-auth-proxy-6964b4f475-jbbw4\" (UID: \"da8125f7-82f3-4401-81e0-8dfa282263c9\") " pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.234179 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.234087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"
Jul 13 21:26:42.364877 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.364840    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4"]
Jul 13 21:26:42.368483 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:26:42.368444    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8125f7_82f3_4401_81e0_8dfa282263c9.slice/crio-37d02c5440808a059a0759a5477e18d1a4ffb087729223fc3acbde1b2edad740 WatchSource:0}: Error finding container 37d02c5440808a059a0759a5477e18d1a4ffb087729223fc3acbde1b2edad740: Status 404 returned error can't find the container with id 37d02c5440808a059a0759a5477e18d1a4ffb087729223fc3acbde1b2edad740
Jul 13 21:26:42.458523 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:42.458478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4" event={"ID":"da8125f7-82f3-4401-81e0-8dfa282263c9","Type":"ContainerStarted","Data":"37d02c5440808a059a0759a5477e18d1a4ffb087729223fc3acbde1b2edad740"}
Jul 13 21:26:43.764710 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.764680    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"]
Jul 13 21:26:43.767062 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.767041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.769401 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.769383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 21:26:43.770337 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.770311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 21:26:43.770414 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.770340    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 21:26:43.770414 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.770396    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-22rlv\""
Jul 13 21:26:43.778968 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.778943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"]
Jul 13 21:26:43.851916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.851884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2csl\" (UniqueName: \"kubernetes.io/projected/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-kube-api-access-p2csl\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.851916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.851923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.852148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.851997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-metrics-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.852148 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.852033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-manager-config\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.953419 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.953384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-metrics-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.953613 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.953442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-manager-config\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.953613 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.953471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2csl\" (UniqueName: \"kubernetes.io/projected/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-kube-api-access-p2csl\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.953613 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.953497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.954323 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.954290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-manager-config\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.956618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.956594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.956724 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.956625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-metrics-cert\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:43.963388 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:43.963360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2csl\" (UniqueName: \"kubernetes.io/projected/9a08b92a-c5b3-4bb8-8d47-96404ab5c879-kube-api-access-p2csl\") pod \"lws-controller-manager-74864c9df6-njwq6\" (UID: \"9a08b92a-c5b3-4bb8-8d47-96404ab5c879\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:44.076955 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:44.076861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:44.232423 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:44.232394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"]
Jul 13 21:26:44.235549 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:26:44.235521    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a08b92a_c5b3_4bb8_8d47_96404ab5c879.slice/crio-1c53c0a873aa82d0323f3bc0cc2449d3ee9dea6a5f692dbcf8d81ce1bfbb1d5f WatchSource:0}: Error finding container 1c53c0a873aa82d0323f3bc0cc2449d3ee9dea6a5f692dbcf8d81ce1bfbb1d5f: Status 404 returned error can't find the container with id 1c53c0a873aa82d0323f3bc0cc2449d3ee9dea6a5f692dbcf8d81ce1bfbb1d5f
Jul 13 21:26:44.467530 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:44.467495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6" event={"ID":"9a08b92a-c5b3-4bb8-8d47-96404ab5c879","Type":"ContainerStarted","Data":"1c53c0a873aa82d0323f3bc0cc2449d3ee9dea6a5f692dbcf8d81ce1bfbb1d5f"}
Jul 13 21:26:46.478082 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:46.478045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4" event={"ID":"da8125f7-82f3-4401-81e0-8dfa282263c9","Type":"ContainerStarted","Data":"f49a4ebf4d304b5524de4d3d5998442b2e3353c1074430e9f01dddddcc85969f"}
Jul 13 21:26:46.479542 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:46.479514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6" event={"ID":"9a08b92a-c5b3-4bb8-8d47-96404ab5c879","Type":"ContainerStarted","Data":"4af08089cb862f55df6d0b6513b6abaf712702a16ff6d3a5d08bf4ad486075dc"}
Jul 13 21:26:46.479685 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:46.479577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:26:46.509916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:46.509802    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6964b4f475-jbbw4" podStartSLOduration=2.439069743 podStartE2EDuration="5.509768476s" totalImagesPullingTime="3.070698733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:46.508541774 +0000 UTC m=+275.933490828" watchObservedRunningTime="2026-07-13 21:26:46.509768476 +0000 UTC m=+275.934717516"
Jul 13 21:26:46.538561 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:46.538499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6" podStartSLOduration=1.5355636879999999 podStartE2EDuration="3.538483231s" totalImagesPullingTime="2.002919543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:46.536282594 +0000 UTC m=+275.961231632" watchObservedRunningTime="2026-07-13 21:26:46.538483231 +0000 UTC m=+275.963432271"
Jul 13 21:26:57.486748 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:26:57.486708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-njwq6"
Jul 13 21:27:11.010868 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:27:11.010838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:27:11.011321 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:27:11.010989    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:27:11.016213 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:27:11.016193    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 21:28:19.279664 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.279626    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"]
Jul 13 21:28:19.282836 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.282818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:19.285153 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.285129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 21:28:19.285873 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.285853    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 21:28:19.285990 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.285885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hnc65\""
Jul 13 21:28:19.292953 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.292932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"]
Jul 13 21:28:19.470324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.470285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwlfg\" (UniqueName: \"kubernetes.io/projected/872f25d7-a647-4d4d-a5e2-965d9050fedc-kube-api-access-mwlfg\") pod \"authorino-operator-75cc8d5cb7-hrhs6\" (UID: \"872f25d7-a647-4d4d-a5e2-965d9050fedc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:19.570965 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.570880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwlfg\" (UniqueName: \"kubernetes.io/projected/872f25d7-a647-4d4d-a5e2-965d9050fedc-kube-api-access-mwlfg\") pod \"authorino-operator-75cc8d5cb7-hrhs6\" (UID: \"872f25d7-a647-4d4d-a5e2-965d9050fedc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:19.579432 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.579392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwlfg\" (UniqueName: \"kubernetes.io/projected/872f25d7-a647-4d4d-a5e2-965d9050fedc-kube-api-access-mwlfg\") pod \"authorino-operator-75cc8d5cb7-hrhs6\" (UID: \"872f25d7-a647-4d4d-a5e2-965d9050fedc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:19.593128 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.593101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:19.727364 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.727338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"]
Jul 13 21:28:19.730008 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:28:19.729982    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872f25d7_a647_4d4d_a5e2_965d9050fedc.slice/crio-53e27590545f5d9952b7ce5325de91c5aae07c9ab7dfa90bf5b1fba5a5ed4685 WatchSource:0}: Error finding container 53e27590545f5d9952b7ce5325de91c5aae07c9ab7dfa90bf5b1fba5a5ed4685: Status 404 returned error can't find the container with id 53e27590545f5d9952b7ce5325de91c5aae07c9ab7dfa90bf5b1fba5a5ed4685
Jul 13 21:28:19.732075 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.732054    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:28:19.823751 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:19.823663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6" event={"ID":"872f25d7-a647-4d4d-a5e2-965d9050fedc","Type":"ContainerStarted","Data":"53e27590545f5d9952b7ce5325de91c5aae07c9ab7dfa90bf5b1fba5a5ed4685"}
Jul 13 21:28:22.839293 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:22.839260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6" event={"ID":"872f25d7-a647-4d4d-a5e2-965d9050fedc","Type":"ContainerStarted","Data":"66e4ce7dbd1617f6360b6f86c7b58c5f101eeb0563e6137be9379e514028109e"}
Jul 13 21:28:22.839675 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:22.839355    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:28:22.858461 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:22.858409    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6" podStartSLOduration=1.51247907 podStartE2EDuration="3.858391774s" totalImagesPullingTime="2.345912704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:28:22.857189982 +0000 UTC m=+372.282139019" watchObservedRunningTime="2026-07-13 21:28:22.858391774 +0000 UTC m=+372.283340815"
Jul 13 21:28:33.845921 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:28:33.845882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hrhs6"
Jul 13 21:29:19.190643 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.190607    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:29:19.192978 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.192955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.195486 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.195463    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x5mck\""
Jul 13 21:29:19.195486 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.195474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 21:29:19.203135 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.203115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:29:19.250868 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.250831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:29:19.279805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.279750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfqk\" (UniqueName: \"kubernetes.io/projected/479f9632-8422-406c-9832-0e07e1c761f4-kube-api-access-ckfqk\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.279974 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.279814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/479f9632-8422-406c-9832-0e07e1c761f4-config-file\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.380960 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.380926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfqk\" (UniqueName: \"kubernetes.io/projected/479f9632-8422-406c-9832-0e07e1c761f4-kube-api-access-ckfqk\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.381126 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.380973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/479f9632-8422-406c-9832-0e07e1c761f4-config-file\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.381541 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.381524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/479f9632-8422-406c-9832-0e07e1c761f4-config-file\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.391361 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.391332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfqk\" (UniqueName: \"kubernetes.io/projected/479f9632-8422-406c-9832-0e07e1c761f4-kube-api-access-ckfqk\") pod \"limitador-limitador-54d6d988d5-4wqd9\" (UID: \"479f9632-8422-406c-9832-0e07e1c761f4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.503213 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.503127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:19.635487 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.635459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:29:19.638436 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:29:19.638409    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479f9632_8422_406c_9832_0e07e1c761f4.slice/crio-91c25f55ba293a123cc3a223e6d2fe75838bde22a3f91f4af8306666c90690c0 WatchSource:0}: Error finding container 91c25f55ba293a123cc3a223e6d2fe75838bde22a3f91f4af8306666c90690c0: Status 404 returned error can't find the container with id 91c25f55ba293a123cc3a223e6d2fe75838bde22a3f91f4af8306666c90690c0
Jul 13 21:29:19.641881 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.641856    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:19.645233 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.645217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:19.647574 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.647558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8prnx\""
Jul 13 21:29:19.653894 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.653866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:19.684450 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.684424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmbz\" (UniqueName: \"kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz\") pod \"authorino-58cd955675-pvzbf\" (UID: \"57fab650-97a4-44bf-b450-d0b1a354d7fb\") " pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:19.785824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.785715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmbz\" (UniqueName: \"kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz\") pod \"authorino-58cd955675-pvzbf\" (UID: \"57fab650-97a4-44bf-b450-d0b1a354d7fb\") " pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:19.797529 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.797502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmbz\" (UniqueName: \"kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz\") pod \"authorino-58cd955675-pvzbf\" (UID: \"57fab650-97a4-44bf-b450-d0b1a354d7fb\") " pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:19.954753 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:19.954712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:20.072808 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:20.072756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9" event={"ID":"479f9632-8422-406c-9832-0e07e1c761f4","Type":"ContainerStarted","Data":"91c25f55ba293a123cc3a223e6d2fe75838bde22a3f91f4af8306666c90690c0"}
Jul 13 21:29:20.097618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:20.097560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:20.101551 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:29:20.101520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57fab650_97a4_44bf_b450_d0b1a354d7fb.slice/crio-37ad812e078d8437464b190e99bf8b9f46450412fb217c52fc1b4778652b22da WatchSource:0}: Error finding container 37ad812e078d8437464b190e99bf8b9f46450412fb217c52fc1b4778652b22da: Status 404 returned error can't find the container with id 37ad812e078d8437464b190e99bf8b9f46450412fb217c52fc1b4778652b22da
Jul 13 21:29:21.080572 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:21.080525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pvzbf" event={"ID":"57fab650-97a4-44bf-b450-d0b1a354d7fb","Type":"ContainerStarted","Data":"37ad812e078d8437464b190e99bf8b9f46450412fb217c52fc1b4778652b22da"}
Jul 13 21:29:23.827055 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:23.827020    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:24.098203 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.098160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9" event={"ID":"479f9632-8422-406c-9832-0e07e1c761f4","Type":"ContainerStarted","Data":"fa08f20f23bc9b4c511e4a97a2bd5d33f15427cb8ec9d0628e40880c02a7e144"}
Jul 13 21:29:24.098391 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.098287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:24.100324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.100280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pvzbf" event={"ID":"57fab650-97a4-44bf-b450-d0b1a354d7fb","Type":"ContainerStarted","Data":"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"}
Jul 13 21:29:24.100462 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.100342    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-pvzbf" podUID="57fab650-97a4-44bf-b450-d0b1a354d7fb" containerName="authorino" containerID="cri-o://b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733" gracePeriod=30
Jul 13 21:29:24.115414 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.115371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9" podStartSLOduration=0.762972869 podStartE2EDuration="5.115354217s" totalImagesPullingTime="4.352381348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:29:24.114191167 +0000 UTC m=+433.539140209" watchObservedRunningTime="2026-07-13 21:29:24.115354217 +0000 UTC m=+433.540303257"
Jul 13 21:29:24.127858 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.127802    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-pvzbf" podStartSLOduration=1.230853411 podStartE2EDuration="5.127767984s" totalImagesPullingTime="3.896914573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:29:24.126682309 +0000 UTC m=+433.551631351" watchObservedRunningTime="2026-07-13 21:29:24.127767984 +0000 UTC m=+433.552717025"
Jul 13 21:29:24.348514 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.348451    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:24.433942 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.433910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lmbz\" (UniqueName: \"kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz\") pod \"57fab650-97a4-44bf-b450-d0b1a354d7fb\" (UID: \"57fab650-97a4-44bf-b450-d0b1a354d7fb\") "
Jul 13 21:29:24.436024 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.436003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz" (OuterVolumeSpecName: "kube-api-access-5lmbz") pod "57fab650-97a4-44bf-b450-d0b1a354d7fb" (UID: "57fab650-97a4-44bf-b450-d0b1a354d7fb"). InnerVolumeSpecName "kube-api-access-5lmbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:29:24.534683 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:24.534643    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lmbz\" (UniqueName: \"kubernetes.io/projected/57fab650-97a4-44bf-b450-d0b1a354d7fb-kube-api-access-5lmbz\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:29:25.106192 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.106156    2565 generic.go:356] "Generic (PLEG): container finished" podID="57fab650-97a4-44bf-b450-d0b1a354d7fb" containerID="b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733" exitCode=2
Jul 13 21:29:25.106630 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.106203    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pvzbf"
Jul 13 21:29:25.106630 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.106235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pvzbf" event={"ID":"57fab650-97a4-44bf-b450-d0b1a354d7fb","Type":"ContainerDied","Data":"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"}
Jul 13 21:29:25.106630 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.106275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pvzbf" event={"ID":"57fab650-97a4-44bf-b450-d0b1a354d7fb","Type":"ContainerDied","Data":"37ad812e078d8437464b190e99bf8b9f46450412fb217c52fc1b4778652b22da"}
Jul 13 21:29:25.106630 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.106292    2565 scope.go:117] "RemoveContainer" containerID="b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"
Jul 13 21:29:25.114926 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.114907    2565 scope.go:117] "RemoveContainer" containerID="b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"
Jul 13 21:29:25.115215 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:29:25.115195    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733\": container with ID starting with b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733 not found: ID does not exist" containerID="b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"
Jul 13 21:29:25.115276 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.115227    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733"} err="failed to get container status \"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733\": rpc error: code = NotFound desc = could not find container \"b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733\": container with ID starting with b75f11b3899dd41ab2d9770641ed61b818b54d8ce3bbb79525b91e6f4034b733 not found: ID does not exist"
Jul 13 21:29:25.127925 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.127895    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:25.132183 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.132158    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-pvzbf"]
Jul 13 21:29:25.169184 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:25.169153    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57fab650-97a4-44bf-b450-d0b1a354d7fb" path="/var/lib/kubelet/pods/57fab650-97a4-44bf-b450-d0b1a354d7fb/volumes"
Jul 13 21:29:35.108180 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:35.108096    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"
Jul 13 21:29:52.374862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.374824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9m7dw"]
Jul 13 21:29:52.375240 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.375137    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57fab650-97a4-44bf-b450-d0b1a354d7fb" containerName="authorino"
Jul 13 21:29:52.375240 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.375148    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57fab650-97a4-44bf-b450-d0b1a354d7fb" containerName="authorino"
Jul 13 21:29:52.375240 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.375214    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="57fab650-97a4-44bf-b450-d0b1a354d7fb" containerName="authorino"
Jul 13 21:29:52.381449 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.381428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:52.383930 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.383908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8prnx\""
Jul 13 21:29:52.384596 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.384571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9m7dw"]
Jul 13 21:29:52.573870 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.573839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nkzv\" (UniqueName: \"kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv\") pod \"authorino-5d4b67c446-9m7dw\" (UID: \"a7f1d325-0903-4f00-a288-76a6bfb11374\") " pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:52.600125 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.600088    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9m7dw"]
Jul 13 21:29:52.600348 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:29:52.600331    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4nkzv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9m7dw" podUID="a7f1d325-0903-4f00-a288-76a6bfb11374"
Jul 13 21:29:52.626887 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.626805    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b677768f-wtd6f"]
Jul 13 21:29:52.633724 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.633694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:52.637070 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.637043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b677768f-wtd6f"]
Jul 13 21:29:52.675127 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.675091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nkzv\" (UniqueName: \"kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv\") pod \"authorino-5d4b67c446-9m7dw\" (UID: \"a7f1d325-0903-4f00-a288-76a6bfb11374\") " pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:52.682704 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.682672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nkzv\" (UniqueName: \"kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv\") pod \"authorino-5d4b67c446-9m7dw\" (UID: \"a7f1d325-0903-4f00-a288-76a6bfb11374\") " pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:52.742985 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.742950    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b677768f-wtd6f"]
Jul 13 21:29:52.743211 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:29:52.743194    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fpjvn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b677768f-wtd6f" podUID="82982d96-25d4-40ce-b117-ca20b937e5fd"
Jul 13 21:29:52.770172 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.770135    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:29:52.772435 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.772419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.774510 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.774494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 21:29:52.776407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.776388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpjvn\" (UniqueName: \"kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn\") pod \"authorino-b677768f-wtd6f\" (UID: \"82982d96-25d4-40ce-b117-ca20b937e5fd\") " pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:52.780443 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.780422    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:29:52.877182 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.877098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l2s7\" (UniqueName: \"kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.877324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.877187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpjvn\" (UniqueName: \"kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn\") pod \"authorino-b677768f-wtd6f\" (UID: \"82982d96-25d4-40ce-b117-ca20b937e5fd\") " pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:52.877324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.877211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.884614 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.884590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpjvn\" (UniqueName: \"kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn\") pod \"authorino-b677768f-wtd6f\" (UID: \"82982d96-25d4-40ce-b117-ca20b937e5fd\") " pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:52.978182 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.978142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.978354 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.978197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l2s7\" (UniqueName: \"kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.980566 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.980534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:52.985391 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:52.985372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l2s7\" (UniqueName: \"kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7\") pod \"authorino-57f8884b6f-hqgcg\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") " pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:53.082188 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.082153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:29:53.216313 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.216290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:29:53.219105 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:29:53.219074    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21f14f10_7945_4e74_8f04_c23176f91421.slice/crio-e824bd37062661a6886f8dadd377723583cf1e401e2783456389fa6255c066ba WatchSource:0}: Error finding container e824bd37062661a6886f8dadd377723583cf1e401e2783456389fa6255c066ba: Status 404 returned error can't find the container with id e824bd37062661a6886f8dadd377723583cf1e401e2783456389fa6255c066ba
Jul 13 21:29:53.220056 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.220043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:53.220128 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.220046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:53.227126 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.227107    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:53.229843 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.229827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:53.280965 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.280934    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nkzv\" (UniqueName: \"kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv\") pod \"a7f1d325-0903-4f00-a288-76a6bfb11374\" (UID: \"a7f1d325-0903-4f00-a288-76a6bfb11374\") "
Jul 13 21:29:53.281131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.280972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpjvn\" (UniqueName: \"kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn\") pod \"82982d96-25d4-40ce-b117-ca20b937e5fd\" (UID: \"82982d96-25d4-40ce-b117-ca20b937e5fd\") "
Jul 13 21:29:53.283067 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.283044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv" (OuterVolumeSpecName: "kube-api-access-4nkzv") pod "a7f1d325-0903-4f00-a288-76a6bfb11374" (UID: "a7f1d325-0903-4f00-a288-76a6bfb11374"). InnerVolumeSpecName "kube-api-access-4nkzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:29:53.283135 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.283079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn" (OuterVolumeSpecName: "kube-api-access-fpjvn") pod "82982d96-25d4-40ce-b117-ca20b937e5fd" (UID: "82982d96-25d4-40ce-b117-ca20b937e5fd"). InnerVolumeSpecName "kube-api-access-fpjvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:29:53.381872 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.381757    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nkzv\" (UniqueName: \"kubernetes.io/projected/a7f1d325-0903-4f00-a288-76a6bfb11374-kube-api-access-4nkzv\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:29:53.381872 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:53.381817    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpjvn\" (UniqueName: \"kubernetes.io/projected/82982d96-25d4-40ce-b117-ca20b937e5fd-kube-api-access-fpjvn\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:29:54.225583 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.225554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9m7dw"
Jul 13 21:29:54.225781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.225602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" event={"ID":"21f14f10-7945-4e74-8f04-c23176f91421","Type":"ContainerStarted","Data":"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"}
Jul 13 21:29:54.225781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.225647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" event={"ID":"21f14f10-7945-4e74-8f04-c23176f91421","Type":"ContainerStarted","Data":"e824bd37062661a6886f8dadd377723583cf1e401e2783456389fa6255c066ba"}
Jul 13 21:29:54.225781 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.225727    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b677768f-wtd6f"
Jul 13 21:29:54.239902 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.239853    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" podStartSLOduration=1.934622456 podStartE2EDuration="2.239834986s" totalImagesPullingTime="305.21253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:29:54.239049641 +0000 UTC m=+463.663998684" watchObservedRunningTime="2026-07-13 21:29:54.239834986 +0000 UTC m=+463.664784027"
Jul 13 21:29:54.267344 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.267313    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9m7dw"]
Jul 13 21:29:54.274334 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.274299    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9m7dw"]
Jul 13 21:29:54.296056 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.295964    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b677768f-wtd6f"]
Jul 13 21:29:54.297351 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:54.297316    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b677768f-wtd6f"]
Jul 13 21:29:55.169777 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:55.169739    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82982d96-25d4-40ce-b117-ca20b937e5fd" path="/var/lib/kubelet/pods/82982d96-25d4-40ce-b117-ca20b937e5fd/volumes"
Jul 13 21:29:55.170184 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:29:55.169997    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f1d325-0903-4f00-a288-76a6bfb11374" path="/var/lib/kubelet/pods/a7f1d325-0903-4f00-a288-76a6bfb11374/volumes"
Jul 13 21:30:34.904213 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:30:34.904175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:30:54.100567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:30:54.100526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:11.577713 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:11.577673    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:17.185076 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:17.185037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:30.274244 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:30.274212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:35.574116 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:35.574079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:37.586867 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.586835    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"]
Jul 13 21:31:37.590152 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.590130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.593897 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.593875    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 21:31:37.593897 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.593887    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 21:31:37.594089 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.593885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 21:31:37.594089 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.593881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rkxvv\""
Jul 13 21:31:37.601290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.601263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"]
Jul 13 21:31:37.753373 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.753373 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8r9k\" (UniqueName: \"kubernetes.io/projected/96a262ff-3faa-41e9-952c-ccdc3ec4c080-kube-api-access-l8r9k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.753617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.753617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.753617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.753617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.753555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.854913 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.854866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.854913 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.854918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855186 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.854939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8r9k\" (UniqueName: \"kubernetes.io/projected/96a262ff-3faa-41e9-952c-ccdc3ec4c080-kube-api-access-l8r9k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855186 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.854973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855186 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.855019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855186 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.855172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855398 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.855370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855573 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.855546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.855729 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.855609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.857303 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.857276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a262ff-3faa-41e9-952c-ccdc3ec4c080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.857418 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.857401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a262ff-3faa-41e9-952c-ccdc3ec4c080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.863398 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.863371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8r9k\" (UniqueName: \"kubernetes.io/projected/96a262ff-3faa-41e9-952c-ccdc3ec4c080-kube-api-access-l8r9k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg\" (UID: \"96a262ff-3faa-41e9-952c-ccdc3ec4c080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:37.899745 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:37.899713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:38.040943 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:38.040908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"]
Jul 13 21:31:38.044398 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:31:38.044372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96a262ff_3faa_41e9_952c_ccdc3ec4c080.slice/crio-51cd70b27159f5301e44a32abd0a275137415e258b6952bfddf33e0a6671d6ff WatchSource:0}: Error finding container 51cd70b27159f5301e44a32abd0a275137415e258b6952bfddf33e0a6671d6ff: Status 404 returned error can't find the container with id 51cd70b27159f5301e44a32abd0a275137415e258b6952bfddf33e0a6671d6ff
Jul 13 21:31:38.679092 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:38.679035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg" event={"ID":"96a262ff-3faa-41e9-952c-ccdc3ec4c080","Type":"ContainerStarted","Data":"51cd70b27159f5301e44a32abd0a275137415e258b6952bfddf33e0a6671d6ff"}
Jul 13 21:31:39.691808 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:39.691750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg" event={"ID":"96a262ff-3faa-41e9-952c-ccdc3ec4c080","Type":"ContainerStarted","Data":"24f8793bc2f7bd3bd3571092ae58be79da9a1974ad2130a017516294a565b9bc"}
Jul 13 21:31:39.708851 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:39.708800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg" podStartSLOduration=1.621755602 podStartE2EDuration="2.708766245s" totalImagesPullingTime="1.087010643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:31:39.707706339 +0000 UTC m=+569.132655381" watchObservedRunningTime="2026-07-13 21:31:39.708766245 +0000 UTC m=+569.133715286"
Jul 13 21:31:45.592480 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:45.592443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:31:47.900298 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:47.900255    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:47.900737 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:47.900317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:47.912895 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:47.912865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:31:48.739550 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:31:48.739522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg"
Jul 13 21:32:11.041102 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:11.041075    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:32:11.042862 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:11.042838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:32:28.263649 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.263607    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f896f5c76-cdxhc"]
Jul 13 21:32:28.267046 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.267018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.274757 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.274728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f896f5c76-cdxhc"]
Jul 13 21:32:28.400032 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.399992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxr2\" (UniqueName: \"kubernetes.io/projected/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-kube-api-access-khxr2\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.400032 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.400041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-tls-cert\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.501228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.501189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khxr2\" (UniqueName: \"kubernetes.io/projected/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-kube-api-access-khxr2\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.501228 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.501233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-tls-cert\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.503735 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.503710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-tls-cert\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.508579 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.508553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxr2\" (UniqueName: \"kubernetes.io/projected/5b559d49-c9c2-49ff-a3f0-1b6d026a409d-kube-api-access-khxr2\") pod \"authorino-f896f5c76-cdxhc\" (UID: \"5b559d49-c9c2-49ff-a3f0-1b6d026a409d\") " pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.577286 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.577209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f896f5c76-cdxhc"
Jul 13 21:32:28.707577 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.707544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f896f5c76-cdxhc"]
Jul 13 21:32:28.711764 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:32:28.711735    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b559d49_c9c2_49ff_a3f0_1b6d026a409d.slice/crio-b713ab0daeb11713221a613ff47386ecb243bfe3452fd8fd8bcc07ea2ed3c5ab WatchSource:0}: Error finding container b713ab0daeb11713221a613ff47386ecb243bfe3452fd8fd8bcc07ea2ed3c5ab: Status 404 returned error can't find the container with id b713ab0daeb11713221a613ff47386ecb243bfe3452fd8fd8bcc07ea2ed3c5ab
Jul 13 21:32:28.904588 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:28.904550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f896f5c76-cdxhc" event={"ID":"5b559d49-c9c2-49ff-a3f0-1b6d026a409d","Type":"ContainerStarted","Data":"b713ab0daeb11713221a613ff47386ecb243bfe3452fd8fd8bcc07ea2ed3c5ab"}
Jul 13 21:32:29.910567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:29.910522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f896f5c76-cdxhc" event={"ID":"5b559d49-c9c2-49ff-a3f0-1b6d026a409d","Type":"ContainerStarted","Data":"c7c9d7d21376cc356d2404bdb247ca1c0d0081b8e6d236b51a8287ec08f0dbfd"}
Jul 13 21:32:29.931610 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:29.931545    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f896f5c76-cdxhc" podStartSLOduration=1.5696298789999998 podStartE2EDuration="1.931522549s" totalImagesPullingTime="361.89267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:32:29.929258371 +0000 UTC m=+619.354207413" watchObservedRunningTime="2026-07-13 21:32:29.931522549 +0000 UTC m=+619.356471594"
Jul 13 21:32:29.959053 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:29.959020    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:32:29.959267 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:29.959242    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" podUID="21f14f10-7945-4e74-8f04-c23176f91421" containerName="authorino" containerID="cri-o://a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4" gracePeriod=30
Jul 13 21:32:30.207751 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.207726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:32:30.317623 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.317579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert\") pod \"21f14f10-7945-4e74-8f04-c23176f91421\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") "
Jul 13 21:32:30.317839 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.317690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l2s7\" (UniqueName: \"kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7\") pod \"21f14f10-7945-4e74-8f04-c23176f91421\" (UID: \"21f14f10-7945-4e74-8f04-c23176f91421\") "
Jul 13 21:32:30.319803 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.319755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7" (OuterVolumeSpecName: "kube-api-access-7l2s7") pod "21f14f10-7945-4e74-8f04-c23176f91421" (UID: "21f14f10-7945-4e74-8f04-c23176f91421"). InnerVolumeSpecName "kube-api-access-7l2s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:32:30.327491 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.327457    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21f14f10-7945-4e74-8f04-c23176f91421" (UID: "21f14f10-7945-4e74-8f04-c23176f91421"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:32:30.419494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.419429    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l2s7\" (UniqueName: \"kubernetes.io/projected/21f14f10-7945-4e74-8f04-c23176f91421-kube-api-access-7l2s7\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:32:30.419494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.419467    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21f14f10-7945-4e74-8f04-c23176f91421-tls-cert\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:32:30.915935 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.915891    2565 generic.go:356] "Generic (PLEG): container finished" podID="21f14f10-7945-4e74-8f04-c23176f91421" containerID="a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4" exitCode=0
Jul 13 21:32:30.915935 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.915942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f8884b6f-hqgcg"
Jul 13 21:32:30.916494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.915982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" event={"ID":"21f14f10-7945-4e74-8f04-c23176f91421","Type":"ContainerDied","Data":"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"}
Jul 13 21:32:30.916494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.916027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f8884b6f-hqgcg" event={"ID":"21f14f10-7945-4e74-8f04-c23176f91421","Type":"ContainerDied","Data":"e824bd37062661a6886f8dadd377723583cf1e401e2783456389fa6255c066ba"}
Jul 13 21:32:30.916494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.916050    2565 scope.go:117] "RemoveContainer" containerID="a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"
Jul 13 21:32:30.927589 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.927567    2565 scope.go:117] "RemoveContainer" containerID="a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"
Jul 13 21:32:30.927934 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:32:30.927909    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4\": container with ID starting with a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4 not found: ID does not exist" containerID="a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"
Jul 13 21:32:30.928003 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.927947    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4"} err="failed to get container status \"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4\": rpc error: code = NotFound desc = could not find container \"a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4\": container with ID starting with a3b05d138978c42707268e91b88ce0236cec4b5aedaca69753160bca13e1f4d4 not found: ID does not exist"
Jul 13 21:32:30.942234 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.942198    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:32:30.949739 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:30.949706    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f8884b6f-hqgcg"]
Jul 13 21:32:31.172219 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:31.172128    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f14f10-7945-4e74-8f04-c23176f91421" path="/var/lib/kubelet/pods/21f14f10-7945-4e74-8f04-c23176f91421/volumes"
Jul 13 21:32:55.687629 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:32:55.687543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:33:06.278410 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:33:06.278377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:33:17.782683 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:33:17.782635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:33:26.579463 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:33:26.579431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:33:37.274987 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:33:37.274950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:34:42.879888 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:34:42.879851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:34:52.480672 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:34:52.480635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:01.291575 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:01.291531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:12.978496 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:12.978454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:23.630886 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:23.630838    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:33.175193 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:33.175111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:44.788487 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:44.788450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:35:54.674942 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:35:54.674906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:36:20.681552 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:36:20.681514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:36:30.078970 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:36:30.078938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:36:51.771649 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:36:51.771603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:02.673972 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:02.673893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:11.068326 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:11.068298    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:37:11.070305 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:11.070283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:37:11.977089 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:11.977048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:20.084453 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:20.084411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:29.877620 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:29.877585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:39.088517 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:39.088478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:49.377567 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:49.377531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:37:58.376406 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:37:58.376371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:39:43.683233 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:39:43.683194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:39:55.181080 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:39:55.181043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:03.870480 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:03.870389    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:14.378131 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:14.378093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:24.175982 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:24.175950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:35.470936 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:35.470897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:44.882046 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:44.882005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:40:55.581129 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:40:55.581090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:41:06.883032 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:41:06.882995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:41:15.978617 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:41:15.978576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:41:28.380739 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:41:28.380703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:41:47.974240 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:41:47.974146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:41:57.388123 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:41:57.388082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:42:06.487954 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:06.487916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:42:11.092947 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:11.092915    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:42:11.095909 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:11.095883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:42:18.780528 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:18.780490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:42:36.197737 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:36.197699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:42:45.683641 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:45.683609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:42:55.083172 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:42:55.083137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:04.487674 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:04.487589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:14.988397 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:14.988359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:24.204824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:24.204775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:37.389438 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:37.389399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:46.779351 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:46.779307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:43:56.092006 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:43:56.091970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:44:08.283961 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:44:08.283925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:44:17.588007 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:44:17.587965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:44:24.383313 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:44:24.383276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:44:40.680109 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:44:40.680029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:44:53.900451 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:44:53.900414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:45:06.812341 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:45:06.812303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:45:21.389368 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:45:21.389329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:45:35.694456 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:45:35.694410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:45:46.784519 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:45:46.784480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:47:01.289373 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:47:01.289340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:47:11.119403 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:47:11.119368    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:47:11.122552 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:47:11.122531    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:47:17.288609 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:47:17.288571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:48:22.385868 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:48:22.385833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:48:30.180831 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:48:30.180768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:49:35.434731 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:49:35.434646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:49:55.182596 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:49:55.182559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:51:07.198558 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:51:07.198525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:52:11.144777 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:52:11.144740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:52:11.148018 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:52:11.147998    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:52:43.878984 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:52:43.878937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:52:53.571494 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:52:53.571457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:53:04.979209 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:53:04.979166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:53:23.379701 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:53:23.379666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:54:03.246640 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:03.246607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:54:10.108873 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.108834    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:54:10.109337 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.109167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f14f10-7945-4e74-8f04-c23176f91421" containerName="authorino"
Jul 13 21:54:10.109337 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.109178    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f14f10-7945-4e74-8f04-c23176f91421" containerName="authorino"
Jul 13 21:54:10.109337 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.109243    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f14f10-7945-4e74-8f04-c23176f91421" containerName="authorino"
Jul 13 21:54:10.112062 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.112044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.121669 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.119184    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bfec26b9\"/\"openshift-service-ca.crt\""
Jul 13 21:54:10.121669 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.119358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bfec26b9\"/\"default-dockercfg-r2xdw\""
Jul 13 21:54:10.121669 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.119742    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bfec26b9\"/\"e2e-lifecycle-model-bfec26b9-kserve-self-signed-certs\""
Jul 13 21:54:10.121669 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.120145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bfec26b9\"/\"kube-root-ca.crt\""
Jul 13 21:54:10.137646 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.137610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:54:10.198203 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.198380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.198380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.198380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpn8j\" (UniqueName: \"kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.198380 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.198523 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.198388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299627 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299829 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299829 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299829 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpn8j\" (UniqueName: \"kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299829 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.299829 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.299753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.300165 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.300133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.300165 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.300153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.300343 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.300213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.302069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.302038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.302274 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.302253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.309881 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.309860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpn8j\" (UniqueName: \"kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j\") pod \"e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") " pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.425474 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.425380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:10.564023 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:10.563931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:54:10.566117 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:54:10.566084    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda8bf83e_dfb1_4a82_b155_a942320b04e5.slice/crio-957567a7734f60b47b3e83e1e29c5c8778da590143c0072035d278286fea1da8 WatchSource:0}: Error finding container 957567a7734f60b47b3e83e1e29c5c8778da590143c0072035d278286fea1da8: Status 404 returned error can't find the container with id 957567a7734f60b47b3e83e1e29c5c8778da590143c0072035d278286fea1da8
Jul 13 21:54:11.538491 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:11.538452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" event={"ID":"da8bf83e-dfb1-4a82-b155-a942320b04e5","Type":"ContainerStarted","Data":"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"}
Jul 13 21:54:11.538916 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:11.538504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" event={"ID":"da8bf83e-dfb1-4a82-b155-a942320b04e5","Type":"ContainerStarted","Data":"957567a7734f60b47b3e83e1e29c5c8778da590143c0072035d278286fea1da8"}
Jul 13 21:54:11.564882 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:11.564832    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" podStartSLOduration=1.5648145740000001 podStartE2EDuration="1.564814574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:54:11.562020633 +0000 UTC m=+1920.986969676" watchObservedRunningTime="2026-07-13 21:54:11.564814574 +0000 UTC m=+1920.989763617"
Jul 13 21:54:14.623311 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:14.623275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:54:20.425747 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:20.425709    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:20.426383 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:20.425852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:20.438385 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:20.438357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:20.591000 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:20.590968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:54:33.289528 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:33.289487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:54:52.045974 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:52.045941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:54:56.837202 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:54:56.837162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:55:11.857681 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:11.857642    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" podUID="da8bf83e-dfb1-4a82-b155-a942320b04e5" containerName="main" containerID="cri-o://bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc" gracePeriod=45
Jul 13 21:55:12.102772 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.102744    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:55:12.150618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpn8j\" (UniqueName: \"kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150618 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150618    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150944 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150944 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150725    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150944 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm\") pod \"da8bf83e-dfb1-4a82-b155-a942320b04e5\" (UID: \"da8bf83e-dfb1-4a82-b155-a942320b04e5\") "
Jul 13 21:55:12.150944 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.150891    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:12.151153 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.151040    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.151753 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.151712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home" (OuterVolumeSpecName: "home") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:12.151915 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.151741    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:12.153379 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.153350    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm" (OuterVolumeSpecName: "dshm") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:12.153560 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.153538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:55:12.153743 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.153723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j" (OuterVolumeSpecName: "kube-api-access-kpn8j") pod "da8bf83e-dfb1-4a82-b155-a942320b04e5" (UID: "da8bf83e-dfb1-4a82-b155-a942320b04e5"). InnerVolumeSpecName "kube-api-access-kpn8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:12.252392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.252153    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.252392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.252194    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8bf83e-dfb1-4a82-b155-a942320b04e5-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.252392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.252209    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpn8j\" (UniqueName: \"kubernetes.io/projected/da8bf83e-dfb1-4a82-b155-a942320b04e5-kube-api-access-kpn8j\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.252392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.252222    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.252392 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.252236    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8bf83e-dfb1-4a82-b155-a942320b04e5-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:55:12.813602 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.813566    2565 generic.go:356] "Generic (PLEG): container finished" podID="da8bf83e-dfb1-4a82-b155-a942320b04e5" containerID="bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc" exitCode=0
Jul 13 21:55:12.813824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.813621    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"
Jul 13 21:55:12.813824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.813640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" event={"ID":"da8bf83e-dfb1-4a82-b155-a942320b04e5","Type":"ContainerDied","Data":"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"}
Jul 13 21:55:12.813824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.813690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj" event={"ID":"da8bf83e-dfb1-4a82-b155-a942320b04e5","Type":"ContainerDied","Data":"957567a7734f60b47b3e83e1e29c5c8778da590143c0072035d278286fea1da8"}
Jul 13 21:55:12.813824 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.813712    2565 scope.go:117] "RemoveContainer" containerID="bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"
Jul 13 21:55:12.823069 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.823048    2565 scope.go:117] "RemoveContainer" containerID="bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"
Jul 13 21:55:12.823379 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:55:12.823354    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc\": container with ID starting with bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc not found: ID does not exist" containerID="bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"
Jul 13 21:55:12.823444 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.823387    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc"} err="failed to get container status \"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc\": rpc error: code = NotFound desc = could not find container \"bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc\": container with ID starting with bb31b96d2457c2e69e06278a039060f8b7687d73e63dd7cb544bcc56b58e87fc not found: ID does not exist"
Jul 13 21:55:12.850706 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.850670    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:55:12.856508 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:12.856483    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-bfec26b9/e2e-lifecycle-model-bfec26b9-kserve-5c8877f7ff-24dmj"]
Jul 13 21:55:13.169714 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:13.169676    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8bf83e-dfb1-4a82-b155-a942320b04e5" path="/var/lib/kubelet/pods/da8bf83e-dfb1-4a82-b155-a942320b04e5/volumes"
Jul 13 21:55:48.185338 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:55:48.185297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:56:02.085749 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:56:02.085705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:56:48.388401 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:56:48.388318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:56:59.574054 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:56:59.574020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:57:06.807407 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.807369    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:57:06.807782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.807705    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8bf83e-dfb1-4a82-b155-a942320b04e5" containerName="main"
Jul 13 21:57:06.807782 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.807716    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8bf83e-dfb1-4a82-b155-a942320b04e5" containerName="main"
Jul 13 21:57:06.807873 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.807806    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8bf83e-dfb1-4a82-b155-a942320b04e5" containerName="main"
Jul 13 21:57:06.810844 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.810825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.814073 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.814044    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6100d7\"/\"test-model-6100d7-kserve-self-signed-certs\""
Jul 13 21:57:06.814073 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.814067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6100d7\"/\"default-dockercfg-dlht5\""
Jul 13 21:57:06.814282 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.814068    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6100d7\"/\"kube-root-ca.crt\""
Jul 13 21:57:06.814282 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.814078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6100d7\"/\"openshift-service-ca.crt\""
Jul 13 21:57:06.821188 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.821167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:57:06.904911 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.904877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.904911 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.904918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.905136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.904944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.905136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.904990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.905136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.905032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:06.905136 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:06.905050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxqp2\" (UniqueName: \"kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006005 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.005966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006182 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006182 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006182 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006290 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqp2\" (UniqueName: \"kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006464 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006510 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.006575 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.006546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.008293 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.008275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.008728 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.008708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.015802 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.015757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxqp2\" (UniqueName: \"kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2\") pod \"test-model-6100d7-kserve-7d8fc69769-fs2rz\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") " pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.121650 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.121604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:07.257655 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.257626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:57:07.260368 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:57:07.260339    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0803e01f_1715_4499_a39e_ce173ec1af45.slice/crio-8e6e739364750107615161389211741c1c8195c5615de493d228c8feac7fee64 WatchSource:0}: Error finding container 8e6e739364750107615161389211741c1c8195c5615de493d228c8feac7fee64: Status 404 returned error can't find the container with id 8e6e739364750107615161389211741c1c8195c5615de493d228c8feac7fee64
Jul 13 21:57:07.311281 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:07.311240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" event={"ID":"0803e01f-1715-4499-a39e-ce173ec1af45","Type":"ContainerStarted","Data":"8e6e739364750107615161389211741c1c8195c5615de493d228c8feac7fee64"}
Jul 13 21:57:08.317232 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:08.317186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" event={"ID":"0803e01f-1715-4499-a39e-ce173ec1af45","Type":"ContainerStarted","Data":"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"}
Jul 13 21:57:08.335231 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:08.335173    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" podStartSLOduration=2.335154471 podStartE2EDuration="2.335154471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:57:08.333308132 +0000 UTC m=+2097.758257172" watchObservedRunningTime="2026-07-13 21:57:08.335154471 +0000 UTC m=+2097.760103512"
Jul 13 21:57:11.180818 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:11.180772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:57:11.185504 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:11.185480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 21:57:11.377700 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:11.377667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:57:17.122203 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:17.122160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:17.122636 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:17.122260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:17.135342 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:17.135311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:17.372833 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:17.372729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:57:22.576943 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:22.576903    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:57:33.187799 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.187743    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:57:33.191071 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.191051    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.193552 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.193520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-04c954\"/\"kube-root-ca.crt\""
Jul 13 21:57:33.194625 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.194591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-04c954\"/\"default-dockercfg-9dxnb\""
Jul 13 21:57:33.194625 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.194592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-04c954\"/\"test-model-04c954-kserve-self-signed-certs\""
Jul 13 21:57:33.194873 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.194702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-04c954\"/\"openshift-service-ca.crt\""
Jul 13 21:57:33.200830 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.200807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:57:33.342027 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.341986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.342211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.342042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.342211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.342108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.342211 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.342141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.342336 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.342226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjh2\" (UniqueName: \"kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.342336 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.342254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443334 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443334 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443564 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443564 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443564 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjh2\" (UniqueName: \"kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443564 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443757 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443828 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.443871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.443841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.445583 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.445553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.445968 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.445949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.450718 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.450700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjh2\" (UniqueName: \"kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2\") pod \"test-model-04c954-kserve-65dd9775ff-gnh7t\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") " pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.500972 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.500935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:33.634264 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:33.634215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:57:33.637166 ip-10-0-136-49 kubenswrapper[2565]: W0713 21:57:33.637136    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a299d65_f4e5_40ef_8f70_9a99f610e728.slice/crio-46d0be2bf9180f3150cdb314ffe83b026839d27192cf899a3e71f164fff85209 WatchSource:0}: Error finding container 46d0be2bf9180f3150cdb314ffe83b026839d27192cf899a3e71f164fff85209: Status 404 returned error can't find the container with id 46d0be2bf9180f3150cdb314ffe83b026839d27192cf899a3e71f164fff85209
Jul 13 21:57:34.433911 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:34.433874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" event={"ID":"8a299d65-f4e5-40ef-8f70-9a99f610e728","Type":"ContainerStarted","Data":"01f65398d34a70a3058ecf2a6463df7b1739f94b14a4b21351fabeb781834ffe"}
Jul 13 21:57:34.434328 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:34.433923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" event={"ID":"8a299d65-f4e5-40ef-8f70-9a99f610e728","Type":"ContainerStarted","Data":"46d0be2bf9180f3150cdb314ffe83b026839d27192cf899a3e71f164fff85209"}
Jul 13 21:57:34.451264 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:34.451206    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" podStartSLOduration=1.451187993 podStartE2EDuration="1.451187993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:57:34.45036561 +0000 UTC m=+2123.875314653" watchObservedRunningTime="2026-07-13 21:57:34.451187993 +0000 UTC m=+2123.876137034"
Jul 13 21:57:37.077284 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:37.077244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:57:43.501871 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:43.501831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:43.502254 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:43.501888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:43.514731 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:43.514701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:44.507452 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:44.507411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:57:51.077984 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:51.077943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:57:52.480551 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:52.480516    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:57:53.399637 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:57:53.399605    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:58:03.171239 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:03.171153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:58:07.501753 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.501695    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" podUID="0803e01f-1715-4499-a39e-ce173ec1af45" containerName="main" containerID="cri-o://9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522" gracePeriod=45
Jul 13 21:58:07.750765 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.750739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:58:07.821805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.821805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.821805 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.822078 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.822078 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.822078 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.821893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxqp2\" (UniqueName: \"kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2\") pod \"0803e01f-1715-4499-a39e-ce173ec1af45\" (UID: \"0803e01f-1715-4499-a39e-ce173ec1af45\") "
Jul 13 21:58:07.822245 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.822077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:07.822245 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.822138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache" (OuterVolumeSpecName: "model-cache") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:07.822245 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.822186    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:07.822756 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.822564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home" (OuterVolumeSpecName: "home") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:07.824932 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.824887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm" (OuterVolumeSpecName: "dshm") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:07.824932 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.824887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:58:07.825071 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.824929    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2" (OuterVolumeSpecName: "kube-api-access-cxqp2") pod "0803e01f-1715-4499-a39e-ce173ec1af45" (UID: "0803e01f-1715-4499-a39e-ce173ec1af45"). InnerVolumeSpecName "kube-api-access-cxqp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:07.923544 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.923505    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0803e01f-1715-4499-a39e-ce173ec1af45-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:07.923544 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.923532    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:07.923544 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.923541    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:07.923544 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.923550    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxqp2\" (UniqueName: \"kubernetes.io/projected/0803e01f-1715-4499-a39e-ce173ec1af45-kube-api-access-cxqp2\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:07.923809 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:07.923559    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0803e01f-1715-4499-a39e-ce173ec1af45-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.421964 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.421922    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" podUID="8a299d65-f4e5-40ef-8f70-9a99f610e728" containerName="main" containerID="cri-o://01f65398d34a70a3058ecf2a6463df7b1739f94b14a4b21351fabeb781834ffe" gracePeriod=45
Jul 13 21:58:08.590744 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.590712    2565 generic.go:356] "Generic (PLEG): container finished" podID="0803e01f-1715-4499-a39e-ce173ec1af45" containerID="9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522" exitCode=0
Jul 13 21:58:08.591226 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.590770    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"
Jul 13 21:58:08.591226 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.590809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" event={"ID":"0803e01f-1715-4499-a39e-ce173ec1af45","Type":"ContainerDied","Data":"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"}
Jul 13 21:58:08.591226 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.590859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz" event={"ID":"0803e01f-1715-4499-a39e-ce173ec1af45","Type":"ContainerDied","Data":"8e6e739364750107615161389211741c1c8195c5615de493d228c8feac7fee64"}
Jul 13 21:58:08.591226 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.590882    2565 scope.go:117] "RemoveContainer" containerID="9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"
Jul 13 21:58:08.592565 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.592537    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a299d65-f4e5-40ef-8f70-9a99f610e728" containerID="01f65398d34a70a3058ecf2a6463df7b1739f94b14a4b21351fabeb781834ffe" exitCode=0
Jul 13 21:58:08.592668 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.592577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" event={"ID":"8a299d65-f4e5-40ef-8f70-9a99f610e728","Type":"ContainerDied","Data":"01f65398d34a70a3058ecf2a6463df7b1739f94b14a4b21351fabeb781834ffe"}
Jul 13 21:58:08.601732 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.601713    2565 scope.go:117] "RemoveContainer" containerID="9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"
Jul 13 21:58:08.602084 ip-10-0-136-49 kubenswrapper[2565]: E0713 21:58:08.602061    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522\": container with ID starting with 9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522 not found: ID does not exist" containerID="9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"
Jul 13 21:58:08.602153 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.602096    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522"} err="failed to get container status \"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522\": rpc error: code = NotFound desc = could not find container \"9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522\": container with ID starting with 9e00d8878c54fbbb377ee04e60f19247f95adc71da240fb6b389c58d3eb58522 not found: ID does not exist"
Jul 13 21:58:08.615207 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.615175    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:58:08.620398 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.620370    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6100d7/test-model-6100d7-kserve-7d8fc69769-fs2rz"]
Jul 13 21:58:08.683127 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.683053    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:58:08.729529 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729696 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729696 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729611    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfjh2\" (UniqueName: \"kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729696 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729696 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729953 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache\") pod \"8a299d65-f4e5-40ef-8f70-9a99f610e728\" (UID: \"8a299d65-f4e5-40ef-8f70-9a99f610e728\") "
Jul 13 21:58:08.729953 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.729828    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home" (OuterVolumeSpecName: "home") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:08.730104 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.730051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:08.730104 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.730091    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.730502 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.730476    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:08.732261 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.732238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2" (OuterVolumeSpecName: "kube-api-access-wfjh2") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "kube-api-access-wfjh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:08.732261 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.732248    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:58:08.732419 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.732326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm" (OuterVolumeSpecName: "dshm") pod "8a299d65-f4e5-40ef-8f70-9a99f610e728" (UID: "8a299d65-f4e5-40ef-8f70-9a99f610e728"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:08.831324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.831284    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.831324 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.831318    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfjh2\" (UniqueName: \"kubernetes.io/projected/8a299d65-f4e5-40ef-8f70-9a99f610e728-kube-api-access-wfjh2\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.831581 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.831350    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.831581 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.831360    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a299d65-f4e5-40ef-8f70-9a99f610e728-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:08.831581 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:08.831368    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a299d65-f4e5-40ef-8f70-9a99f610e728-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 21:58:09.169235 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.169202    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0803e01f-1715-4499-a39e-ce173ec1af45" path="/var/lib/kubelet/pods/0803e01f-1715-4499-a39e-ce173ec1af45/volumes"
Jul 13 21:58:09.598848 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.598819    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"
Jul 13 21:58:09.599306 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.598817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t" event={"ID":"8a299d65-f4e5-40ef-8f70-9a99f610e728","Type":"ContainerDied","Data":"46d0be2bf9180f3150cdb314ffe83b026839d27192cf899a3e71f164fff85209"}
Jul 13 21:58:09.599306 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.598948    2565 scope.go:117] "RemoveContainer" containerID="01f65398d34a70a3058ecf2a6463df7b1739f94b14a4b21351fabeb781834ffe"
Jul 13 21:58:09.615537 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.615504    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:58:09.617546 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:09.617524    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-04c954/test-model-04c954-kserve-65dd9775ff-gnh7t"]
Jul 13 21:58:11.169428 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:11.169396    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a299d65-f4e5-40ef-8f70-9a99f610e728" path="/var/lib/kubelet/pods/8a299d65-f4e5-40ef-8f70-9a99f610e728/volumes"
Jul 13 21:58:13.275821 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:13.275761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:58:33.073076 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:33.073036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:58:55.084727 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:58:55.084691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:59:08.778853 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:59:08.778809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:59:24.289864 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:59:24.289820    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 21:59:49.774729 ip-10-0-136-49 kubenswrapper[2565]: I0713 21:59:49.774643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:00:11.380216 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:11.380178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:00:23.481118 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:23.481083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:00:33.079915 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.079878    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:00:33.080285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080192    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0803e01f-1715-4499-a39e-ce173ec1af45" containerName="main"
Jul 13 22:00:33.080285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080204    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0803e01f-1715-4499-a39e-ce173ec1af45" containerName="main"
Jul 13 22:00:33.080285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a299d65-f4e5-40ef-8f70-9a99f610e728" containerName="main"
Jul 13 22:00:33.080285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a299d65-f4e5-40ef-8f70-9a99f610e728" containerName="main"
Jul 13 22:00:33.080415 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080304    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a299d65-f4e5-40ef-8f70-9a99f610e728" containerName="main"
Jul 13 22:00:33.080415 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.080314    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0803e01f-1715-4499-a39e-ce173ec1af45" containerName="main"
Jul 13 22:00:33.082966 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.082946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.085727 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.085704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"auth-test-model-44ef67-kserve-self-signed-certs\""
Jul 13 22:00:33.086661 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.086640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"openshift-service-ca.crt\""
Jul 13 22:00:33.086799 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.086666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"kube-root-ca.crt\""
Jul 13 22:00:33.086870 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.086845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"default-dockercfg-w46d9\""
Jul 13 22:00:33.095634 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.095610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:00:33.172023 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.171990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.172023 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.172024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.172253 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.172046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8h5\" (UniqueName: \"kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.172253 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.172091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.172253 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.172116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.172253 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.172144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273350 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8h5\" (UniqueName: \"kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.273954 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.274000 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.273969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.275876 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.275849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.276169 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.276148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.281818 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.281776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8h5\" (UniqueName: \"kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5\") pod \"auth-test-model-44ef67-kserve-774f85685f-tkxx5\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") " pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.392383 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.392348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:33.523162 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:33.523059    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:00:33.525397 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:00:33.525365    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad71c3dc_5be9_4498_8717_c79a4c64bfee.slice/crio-0ff8f88560f2d1ac499aa3ee3914e7fea8ad83b277d1b1534c9f3525ae20c428 WatchSource:0}: Error finding container 0ff8f88560f2d1ac499aa3ee3914e7fea8ad83b277d1b1534c9f3525ae20c428: Status 404 returned error can't find the container with id 0ff8f88560f2d1ac499aa3ee3914e7fea8ad83b277d1b1534c9f3525ae20c428
Jul 13 22:00:34.243064 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:34.243029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" event={"ID":"ad71c3dc-5be9-4498-8717-c79a4c64bfee","Type":"ContainerStarted","Data":"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"}
Jul 13 22:00:34.243064 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:34.243072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" event={"ID":"ad71c3dc-5be9-4498-8717-c79a4c64bfee","Type":"ContainerStarted","Data":"0ff8f88560f2d1ac499aa3ee3914e7fea8ad83b277d1b1534c9f3525ae20c428"}
Jul 13 22:00:34.260857 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:34.260806    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" podStartSLOduration=1.260775397 podStartE2EDuration="1.260775397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:00:34.259697077 +0000 UTC m=+2303.684646119" watchObservedRunningTime="2026-07-13 22:00:34.260775397 +0000 UTC m=+2303.685724474"
Jul 13 22:00:36.574519 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:36.574483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:00:43.392859 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:43.392813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:43.393366 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:43.392877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:43.405572 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:43.405536    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:00:44.295502 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:00:44.295474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:01:23.801350 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.801316    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:01:23.804958 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.804938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.808498 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.808471    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"auth-test-model-f0e328-kserve-self-signed-certs\""
Jul 13 22:01:23.808626 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.808479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"default-dockercfg-566z9\""
Jul 13 22:01:23.808626 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.808480    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"kube-root-ca.crt\""
Jul 13 22:01:23.808626 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.808571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"openshift-service-ca.crt\""
Jul 13 22:01:23.810567 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.810651 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.810704 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.810704 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsm4\" (UniqueName: \"kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.810835 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.810903 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.810835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.822362 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.822340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:01:23.911953 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.911914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.911953 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.911955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.911974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.911996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.912053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.912091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsm4\" (UniqueName: \"kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912403 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.912374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912458 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.912402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.912458 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.912439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.914394 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.914368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.914612 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.914594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:23.922721 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:23.922697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsm4\" (UniqueName: \"kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4\") pod \"auth-test-model-f0e328-kserve-7559cf5bc9-d9mts\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") " pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:24.114187 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:24.114154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:24.247827 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:24.247660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:01:24.250492 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:01:24.250466    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc710b546_b1fa_4f9e_a01c_7750236720dd.slice/crio-cd1fcb533e395f69f0c46ef52fec2ae6d41da2318c1563e4f4cef7bc3be72263 WatchSource:0}: Error finding container cd1fcb533e395f69f0c46ef52fec2ae6d41da2318c1563e4f4cef7bc3be72263: Status 404 returned error can't find the container with id cd1fcb533e395f69f0c46ef52fec2ae6d41da2318c1563e4f4cef7bc3be72263
Jul 13 22:01:24.463199 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:24.463093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" event={"ID":"c710b546-b1fa-4f9e-a01c-7750236720dd","Type":"ContainerStarted","Data":"01343caa190a8ec6a603dea3a43178e6441defdd12bf91cd5db8a8f3f7925040"}
Jul 13 22:01:24.463199 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:24.463147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" event={"ID":"c710b546-b1fa-4f9e-a01c-7750236720dd","Type":"ContainerStarted","Data":"cd1fcb533e395f69f0c46ef52fec2ae6d41da2318c1563e4f4cef7bc3be72263"}
Jul 13 22:01:24.481804 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:24.481742    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" podStartSLOduration=1.481725448 podStartE2EDuration="1.481725448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:01:24.480616927 +0000 UTC m=+2353.905565979" watchObservedRunningTime="2026-07-13 22:01:24.481725448 +0000 UTC m=+2353.906674493"
Jul 13 22:01:27.597997 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:27.597178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:01:34.115005 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:34.114965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:34.115410 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:34.115029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:34.127833 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:34.127805    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:34.524707 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:34.524619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:01:41.782266 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:41.782228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:01:55.980029 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:01:55.979989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:02:11.207645 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:02:11.207616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 22:02:11.211529 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:02:11.211508    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 22:02:12.491569 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:02:12.491538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:02:31.287701 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:02:31.287664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:02:49.575370 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:02:49.575291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:03:06.277409 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:06.277371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:03:20.033617 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:20.033578    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:03:20.868535 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:20.868491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:03:24.882326 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:24.882290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:03:25.386542 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.386507    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:03:25.389682 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.389663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.392134 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.392115    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"sub-test-model-44ef67-kserve-self-signed-certs\""
Jul 13 22:03:25.400157 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.400130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:03:25.510686 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.510686 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrdq\" (UniqueName: \"kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.510930 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.510930 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.510930 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.510930 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.510895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.611994 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.611951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrdq\" (UniqueName: \"kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612461 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612521 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.612582 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.612538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.614448 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.614420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.614614 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.614596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.621082 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.621056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrdq\" (UniqueName: \"kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq\") pod \"sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") " pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.699937 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.699846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:25.833595 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:25.833569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:03:25.836209 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:03:25.836180    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc242ac60_f943_4844_a1cf_d4816dd532df.slice/crio-56d81b44951b30b3b299fc0dab4174c6744a44befaaa04b70b4e67392ed98c6f WatchSource:0}: Error finding container 56d81b44951b30b3b299fc0dab4174c6744a44befaaa04b70b4e67392ed98c6f: Status 404 returned error can't find the container with id 56d81b44951b30b3b299fc0dab4174c6744a44befaaa04b70b4e67392ed98c6f
Jul 13 22:03:26.011970 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:26.011874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" event={"ID":"c242ac60-f943-4844-a1cf-d4816dd532df","Type":"ContainerStarted","Data":"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"}
Jul 13 22:03:26.011970 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:26.011920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" event={"ID":"c242ac60-f943-4844-a1cf-d4816dd532df","Type":"ContainerStarted","Data":"56d81b44951b30b3b299fc0dab4174c6744a44befaaa04b70b4e67392ed98c6f"}
Jul 13 22:03:26.028079 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:26.028029    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" podStartSLOduration=1.028014158 podStartE2EDuration="1.028014158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:03:26.026813499 +0000 UTC m=+2475.451762738" watchObservedRunningTime="2026-07-13 22:03:26.028014158 +0000 UTC m=+2475.452963234"
Jul 13 22:03:35.054666 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.054621    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" podUID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" containerName="main" containerID="cri-o://197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d" gracePeriod=45
Jul 13 22:03:35.314010 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.313948    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:03:35.503673 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx8h5\" (UniqueName: \"kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.503860 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.503860 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.503860 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503744    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.503980 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.503980 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home\") pod \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\" (UID: \"ad71c3dc-5be9-4498-8717-c79a4c64bfee\") "
Jul 13 22:03:35.504087 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.503986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:35.504201 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.504172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:35.504254 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.504181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home" (OuterVolumeSpecName: "home") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:35.504254 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.504243    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.506083 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.506053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm" (OuterVolumeSpecName: "dshm") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:35.506083 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.506060    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5" (OuterVolumeSpecName: "kube-api-access-sx8h5") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "kube-api-access-sx8h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:03:35.506210 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.506082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad71c3dc-5be9-4498-8717-c79a4c64bfee" (UID: "ad71c3dc-5be9-4498-8717-c79a4c64bfee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:03:35.605146 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.605114    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.605146 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.605143    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.605324 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.605152    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.605324 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.605163    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad71c3dc-5be9-4498-8717-c79a4c64bfee-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.605324 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.605171    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx8h5\" (UniqueName: \"kubernetes.io/projected/ad71c3dc-5be9-4498-8717-c79a4c64bfee-kube-api-access-sx8h5\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:35.700193 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.700153    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:35.700340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.700210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:35.712832 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.712779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:35.890103 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:35.890012    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" podUID="c710b546-b1fa-4f9e-a01c-7750236720dd" containerName="main" containerID="cri-o://01343caa190a8ec6a603dea3a43178e6441defdd12bf91cd5db8a8f3f7925040" gracePeriod=45
Jul 13 22:03:36.058947 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.058753    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" containerID="197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d" exitCode=0
Jul 13 22:03:36.058947 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.058923    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"
Jul 13 22:03:36.059406 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.059087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" event={"ID":"ad71c3dc-5be9-4498-8717-c79a4c64bfee","Type":"ContainerDied","Data":"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"}
Jul 13 22:03:36.059406 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.059148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5" event={"ID":"ad71c3dc-5be9-4498-8717-c79a4c64bfee","Type":"ContainerDied","Data":"0ff8f88560f2d1ac499aa3ee3914e7fea8ad83b277d1b1534c9f3525ae20c428"}
Jul 13 22:03:36.059406 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.059174    2565 scope.go:117] "RemoveContainer" containerID="197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"
Jul 13 22:03:36.061514 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.061493    2565 generic.go:356] "Generic (PLEG): container finished" podID="c710b546-b1fa-4f9e-a01c-7750236720dd" containerID="01343caa190a8ec6a603dea3a43178e6441defdd12bf91cd5db8a8f3f7925040" exitCode=0
Jul 13 22:03:36.061627 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.061564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" event={"ID":"c710b546-b1fa-4f9e-a01c-7750236720dd","Type":"ContainerDied","Data":"01343caa190a8ec6a603dea3a43178e6441defdd12bf91cd5db8a8f3f7925040"}
Jul 13 22:03:36.074742 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.074719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:03:36.082074 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.082004    2565 scope.go:117] "RemoveContainer" containerID="197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"
Jul 13 22:03:36.082468 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:03:36.082406    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d\": container with ID starting with 197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d not found: ID does not exist" containerID="197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"
Jul 13 22:03:36.082468 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.082453    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d"} err="failed to get container status \"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d\": rpc error: code = NotFound desc = could not find container \"197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d\": container with ID starting with 197bcb5c12ae29cb68cca5b5126720d1cc03a575c9a90d2d0d8c78917c4a154d not found: ID does not exist"
Jul 13 22:03:36.087465 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.087444    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:03:36.097844 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.093579    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/auth-test-model-44ef67-kserve-774f85685f-tkxx5"]
Jul 13 22:03:36.145127 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.145063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:03:36.311145 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxsm4\" (UniqueName: \"kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311253    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311560 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311347    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache\") pod \"c710b546-b1fa-4f9e-a01c-7750236720dd\" (UID: \"c710b546-b1fa-4f9e-a01c-7750236720dd\") "
Jul 13 22:03:36.311617 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311577    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home" (OuterVolumeSpecName: "home") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:36.311692 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:36.311692 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311627    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:36.311822 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311736    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:36.311822 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311757    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:36.311822 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.311771    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:36.313611 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.313584    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm" (OuterVolumeSpecName: "dshm") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:03:36.313717 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.313616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4" (OuterVolumeSpecName: "kube-api-access-pxsm4") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "kube-api-access-pxsm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:03:36.313717 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.313652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c710b546-b1fa-4f9e-a01c-7750236720dd" (UID: "c710b546-b1fa-4f9e-a01c-7750236720dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:03:36.413250 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.413160    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c710b546-b1fa-4f9e-a01c-7750236720dd-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:36.413250 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.413191    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxsm4\" (UniqueName: \"kubernetes.io/projected/c710b546-b1fa-4f9e-a01c-7750236720dd-kube-api-access-pxsm4\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:36.413250 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:36.413201    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c710b546-b1fa-4f9e-a01c-7750236720dd-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:03:37.067756 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.067725    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"
Jul 13 22:03:37.068225 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.067769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts" event={"ID":"c710b546-b1fa-4f9e-a01c-7750236720dd","Type":"ContainerDied","Data":"cd1fcb533e395f69f0c46ef52fec2ae6d41da2318c1563e4f4cef7bc3be72263"}
Jul 13 22:03:37.068225 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.067856    2565 scope.go:117] "RemoveContainer" containerID="01343caa190a8ec6a603dea3a43178e6441defdd12bf91cd5db8a8f3f7925040"
Jul 13 22:03:37.087907 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.087875    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:03:37.092008 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.091985    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/auth-test-model-f0e328-kserve-7559cf5bc9-d9mts"]
Jul 13 22:03:37.169356 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.169316    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" path="/var/lib/kubelet/pods/ad71c3dc-5be9-4498-8717-c79a4c64bfee/volumes"
Jul 13 22:03:37.169802 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:37.169773    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c710b546-b1fa-4f9e-a01c-7750236720dd" path="/var/lib/kubelet/pods/c710b546-b1fa-4f9e-a01c-7750236720dd/volumes"
Jul 13 22:03:40.781427 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:40.781384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:03:51.491337 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491302    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491701    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c710b546-b1fa-4f9e-a01c-7750236720dd" containerName="main"
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c710b546-b1fa-4f9e-a01c-7750236720dd" containerName="main"
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491725    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" containerName="main"
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491731    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" containerName="main"
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491808    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad71c3dc-5be9-4498-8717-c79a4c64bfee" containerName="main"
Jul 13 22:03:51.491842 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.491824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c710b546-b1fa-4f9e-a01c-7750236720dd" containerName="main"
Jul 13 22:03:51.494556 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.494534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.497953 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.497925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"default-dockercfg-566z9\""
Jul 13 22:03:51.498109 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.497999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"kube-root-ca.crt\""
Jul 13 22:03:51.498109 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.498063    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"openshift-service-ca.crt\""
Jul 13 22:03:51.498109 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.498065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"sub-test-model-f0e328-kserve-self-signed-certs\""
Jul 13 22:03:51.504269 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.504244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:03:51.528033 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.527998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.528180 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.528043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.528180 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.528061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.528180 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.528130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.528295 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.528188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.528295 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.528238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64k7x\" (UniqueName: \"kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628649 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.628884 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.628812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64k7x\" (UniqueName: \"kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.629136 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.629110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.629216 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.629190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.629257 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.629217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.631067 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.631038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.631262 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.631245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.636736 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.636714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64k7x\" (UniqueName: \"kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x\") pod \"sub-test-model-f0e328-kserve-77f688f6c-dgmgk\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") " pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.804248 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.804158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:03:51.935230 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:51.935201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:03:51.937753 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:03:51.937726    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod854a5ad8_610b_466a_8050_80da5b73cf83.slice/crio-a49958c6b4cb36d7687cbb43ab88384e95db831ccfa644942d9f9e885287457c WatchSource:0}: Error finding container a49958c6b4cb36d7687cbb43ab88384e95db831ccfa644942d9f9e885287457c: Status 404 returned error can't find the container with id a49958c6b4cb36d7687cbb43ab88384e95db831ccfa644942d9f9e885287457c
Jul 13 22:03:52.139982 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:52.139942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" event={"ID":"854a5ad8-610b-466a-8050-80da5b73cf83","Type":"ContainerStarted","Data":"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"}
Jul 13 22:03:52.140170 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:52.139994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" event={"ID":"854a5ad8-610b-466a-8050-80da5b73cf83","Type":"ContainerStarted","Data":"a49958c6b4cb36d7687cbb43ab88384e95db831ccfa644942d9f9e885287457c"}
Jul 13 22:03:52.157349 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:52.157295    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" podStartSLOduration=1.157275735 podStartE2EDuration="1.157275735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:03:52.155102941 +0000 UTC m=+2501.580052038" watchObservedRunningTime="2026-07-13 22:03:52.157275735 +0000 UTC m=+2501.582224775"
Jul 13 22:03:56.582889 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:03:56.582850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:04:01.804478 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:01.804433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:01.804911 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:01.804490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:01.817502 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:01.817468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:02.199030 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:02.198943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:12.081285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:12.081239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:04:27.936287 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:27.936251    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:04:28.773619 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:28.773587    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:04:32.424216 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:32.424176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:04:34.793976 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.793940    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:04:34.796965 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.796946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.799563 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.799537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44ef67\"/\"rate-test-model-44ef67-kserve-self-signed-certs\""
Jul 13 22:04:34.802800 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.802756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.802916 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.802815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.802916 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.802844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.802916 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.802887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.803084 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.802936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.803084 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.803012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ll7\" (UniqueName: \"kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.807487 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.807461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:04:34.903913 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.903871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ll7\" (UniqueName: \"kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.903959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.903984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904398 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904456 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.904576 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.904454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.906539 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.906509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.906671 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.906641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:34.913749 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:34.913719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ll7\" (UniqueName: \"kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7\") pod \"rate-test-model-44ef67-kserve-64c789d68c-n8zdx\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") " pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:35.107018 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:35.106983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:35.239479 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:35.239439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:04:35.243297 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:04:35.243267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18bf5878_8795_4e87_bc95_b6fa5a398d80.slice/crio-785585a5994846ec2c0e34e0854028546ca0baab7201f1395d721b4b9abf2fa1 WatchSource:0}: Error finding container 785585a5994846ec2c0e34e0854028546ca0baab7201f1395d721b4b9abf2fa1: Status 404 returned error can't find the container with id 785585a5994846ec2c0e34e0854028546ca0baab7201f1395d721b4b9abf2fa1
Jul 13 22:04:35.329970 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:35.329929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" event={"ID":"18bf5878-8795-4e87-bc95-b6fa5a398d80","Type":"ContainerStarted","Data":"62087d489c792d7cfaf58004b543c8e5bb2549d6307435d8d79338864be325f5"}
Jul 13 22:04:35.330168 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:35.329989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" event={"ID":"18bf5878-8795-4e87-bc95-b6fa5a398d80","Type":"ContainerStarted","Data":"785585a5994846ec2c0e34e0854028546ca0baab7201f1395d721b4b9abf2fa1"}
Jul 13 22:04:35.346981 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:35.346926    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" podStartSLOduration=1.346907941 podStartE2EDuration="1.346907941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:04:35.345219458 +0000 UTC m=+2544.770168494" watchObservedRunningTime="2026-07-13 22:04:35.346907941 +0000 UTC m=+2544.771856982"
Jul 13 22:04:42.956036 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:42.955972    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" podUID="c242ac60-f943-4844-a1cf-d4816dd532df" containerName="main" containerID="cri-o://7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18" gracePeriod=45
Jul 13 22:04:43.208172 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.208108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:04:43.270452 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270672 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270513    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270672 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270539    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270672 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270672 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270630    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270929 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270685    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zrdq\" (UniqueName: \"kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq\") pod \"c242ac60-f943-4844-a1cf-d4816dd532df\" (UID: \"c242ac60-f943-4844-a1cf-d4816dd532df\") "
Jul 13 22:04:43.270929 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home" (OuterVolumeSpecName: "home") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:43.271036 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270933    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:43.271036 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.270954    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache" (OuterVolumeSpecName: "model-cache") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:43.271036 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.271015    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.271191 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.271058    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.272629 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.272603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:04:43.272731 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.272708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq" (OuterVolumeSpecName: "kube-api-access-8zrdq") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "kube-api-access-8zrdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:04:43.272780 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.272733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm" (OuterVolumeSpecName: "dshm") pod "c242ac60-f943-4844-a1cf-d4816dd532df" (UID: "c242ac60-f943-4844-a1cf-d4816dd532df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:43.368006 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.367970    2565 generic.go:356] "Generic (PLEG): container finished" podID="c242ac60-f943-4844-a1cf-d4816dd532df" containerID="7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18" exitCode=0
Jul 13 22:04:43.368177 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.368012    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"
Jul 13 22:04:43.368177 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.368015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" event={"ID":"c242ac60-f943-4844-a1cf-d4816dd532df","Type":"ContainerDied","Data":"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"}
Jul 13 22:04:43.368177 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.368054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql" event={"ID":"c242ac60-f943-4844-a1cf-d4816dd532df","Type":"ContainerDied","Data":"56d81b44951b30b3b299fc0dab4174c6744a44befaaa04b70b4e67392ed98c6f"}
Jul 13 22:04:43.368177 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.368074    2565 scope.go:117] "RemoveContainer" containerID="7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"
Jul 13 22:04:43.372056 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.372029    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.372056 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.372049    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c242ac60-f943-4844-a1cf-d4816dd532df-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.372056 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.372059    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zrdq\" (UniqueName: \"kubernetes.io/projected/c242ac60-f943-4844-a1cf-d4816dd532df-kube-api-access-8zrdq\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.372264 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.372068    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c242ac60-f943-4844-a1cf-d4816dd532df-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:43.377676 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.377589    2565 scope.go:117] "RemoveContainer" containerID="7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"
Jul 13 22:04:43.379228 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:04:43.379203    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18\": container with ID starting with 7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18 not found: ID does not exist" containerID="7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"
Jul 13 22:04:43.379334 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.379237    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18"} err="failed to get container status \"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18\": rpc error: code = NotFound desc = could not find container \"7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18\": container with ID starting with 7f23d15148b071e6737966bea2e9c887210044ec62c8409e8ecfd9a049330e18 not found: ID does not exist"
Jul 13 22:04:43.395944 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.395915    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:04:43.404120 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.404088    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/sub-test-model-44ef67-kserve-6bf85bd4dc-2ktql"]
Jul 13 22:04:43.793572 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:43.793527    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" podUID="854a5ad8-610b-466a-8050-80da5b73cf83" containerName="main" containerID="cri-o://83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74" gracePeriod=45
Jul 13 22:04:44.045041 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.044976    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:44.078126 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078085    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078126 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64k7x\" (UniqueName: \"kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078388 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078388 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078388 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078553 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home\") pod \"854a5ad8-610b-466a-8050-80da5b73cf83\" (UID: \"854a5ad8-610b-466a-8050-80da5b73cf83\") "
Jul 13 22:04:44.078602 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:44.078707 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078689    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.078778 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078687    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache" (OuterVolumeSpecName: "model-cache") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:44.078778 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.078726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home" (OuterVolumeSpecName: "home") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:44.080509 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.080483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm" (OuterVolumeSpecName: "dshm") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:04:44.080509 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.080496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x" (OuterVolumeSpecName: "kube-api-access-64k7x") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "kube-api-access-64k7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:04:44.080721 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.080704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "854a5ad8-610b-466a-8050-80da5b73cf83" (UID: "854a5ad8-610b-466a-8050-80da5b73cf83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:04:44.179556 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.179515    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.179556 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.179548    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.179556 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.179558    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64k7x\" (UniqueName: \"kubernetes.io/projected/854a5ad8-610b-466a-8050-80da5b73cf83-kube-api-access-64k7x\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.179556 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.179567    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/854a5ad8-610b-466a-8050-80da5b73cf83-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.179860 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.179577    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854a5ad8-610b-466a-8050-80da5b73cf83-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:04:44.374718 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.374686    2565 generic.go:356] "Generic (PLEG): container finished" podID="854a5ad8-610b-466a-8050-80da5b73cf83" containerID="83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74" exitCode=0
Jul 13 22:04:44.374926 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.374737    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"
Jul 13 22:04:44.374926 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.374781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" event={"ID":"854a5ad8-610b-466a-8050-80da5b73cf83","Type":"ContainerDied","Data":"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"}
Jul 13 22:04:44.374926 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.374847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk" event={"ID":"854a5ad8-610b-466a-8050-80da5b73cf83","Type":"ContainerDied","Data":"a49958c6b4cb36d7687cbb43ab88384e95db831ccfa644942d9f9e885287457c"}
Jul 13 22:04:44.374926 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.374871    2565 scope.go:117] "RemoveContainer" containerID="83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"
Jul 13 22:04:44.383002 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.382986    2565 scope.go:117] "RemoveContainer" containerID="83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"
Jul 13 22:04:44.383260 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:04:44.383243    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74\": container with ID starting with 83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74 not found: ID does not exist" containerID="83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"
Jul 13 22:04:44.383299 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.383271    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74"} err="failed to get container status \"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74\": rpc error: code = NotFound desc = could not find container \"83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74\": container with ID starting with 83012a66ad9c8b278f4f8a3495764ff03698e3d84345e438d8bb0e3294244d74 not found: ID does not exist"
Jul 13 22:04:44.395383 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.395357    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:04:44.398613 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.398591    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/sub-test-model-f0e328-kserve-77f688f6c-dgmgk"]
Jul 13 22:04:44.586273 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:44.586239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:04:45.107167 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.107128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:45.107651 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.107191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:45.119874 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.119848    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:45.170878 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.170843    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854a5ad8-610b-466a-8050-80da5b73cf83" path="/var/lib/kubelet/pods/854a5ad8-610b-466a-8050-80da5b73cf83/volumes"
Jul 13 22:04:45.171299 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.171284    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c242ac60-f943-4844-a1cf-d4816dd532df" path="/var/lib/kubelet/pods/c242ac60-f943-4844-a1cf-d4816dd532df/volumes"
Jul 13 22:04:45.397966 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:45.397876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:04:54.485659 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.485622    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:04:54.486029 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.485968    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854a5ad8-610b-466a-8050-80da5b73cf83" containerName="main"
Jul 13 22:04:54.486029 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.485980    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="854a5ad8-610b-466a-8050-80da5b73cf83" containerName="main"
Jul 13 22:04:54.486029 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.485991    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c242ac60-f943-4844-a1cf-d4816dd532df" containerName="main"
Jul 13 22:04:54.486029 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.485997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c242ac60-f943-4844-a1cf-d4816dd532df" containerName="main"
Jul 13 22:04:54.486168 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.486047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="854a5ad8-610b-466a-8050-80da5b73cf83" containerName="main"
Jul 13 22:04:54.486168 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.486058    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c242ac60-f943-4844-a1cf-d4816dd532df" containerName="main"
Jul 13 22:04:54.488925 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.488904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.491394 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.491368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"openshift-service-ca.crt\""
Jul 13 22:04:54.491531 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.491368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"kube-root-ca.crt\""
Jul 13 22:04:54.492162 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.492145    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"default-dockercfg-566z9\""
Jul 13 22:04:54.492264 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.492201    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f0e328\"/\"rate-test-model-f0e328-kserve-self-signed-certs\""
Jul 13 22:04:54.499197 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.499175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:04:54.578028 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.577989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.578215 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.578056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfdrn\" (UniqueName: \"kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.578215 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.578153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.578289 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.578248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.578289 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.578277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.578351 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.578302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.678906 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.678869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfdrn\" (UniqueName: \"kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679079 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.678914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679079 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.678965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679079 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.678981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679079 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.678996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679255 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.679095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679425 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.679404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679501 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.679434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.679553 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.679495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.681359 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.681341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.681475 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.681457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.687422 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.687400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfdrn\" (UniqueName: \"kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn\") pod \"rate-test-model-f0e328-kserve-6855cb77c9-t79rk\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") " pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.798545 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.798437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:04:54.929014 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:54.928978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:04:54.931520 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:04:54.931492    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode23074d8_4f00_408f_9e18_7d09ca008ae4.slice/crio-989a7e42d7c8a47cb3db95a2697179580136140faad1fb377f33980429f13e9b WatchSource:0}: Error finding container 989a7e42d7c8a47cb3db95a2697179580136140faad1fb377f33980429f13e9b: Status 404 returned error can't find the container with id 989a7e42d7c8a47cb3db95a2697179580136140faad1fb377f33980429f13e9b
Jul 13 22:04:55.427199 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:55.427160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" event={"ID":"e23074d8-4f00-408f-9e18-7d09ca008ae4","Type":"ContainerStarted","Data":"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"}
Jul 13 22:04:55.427199 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:55.427203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" event={"ID":"e23074d8-4f00-408f-9e18-7d09ca008ae4","Type":"ContainerStarted","Data":"989a7e42d7c8a47cb3db95a2697179580136140faad1fb377f33980429f13e9b"}
Jul 13 22:04:55.444803 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:04:55.444748    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" podStartSLOduration=1.444733506 podStartE2EDuration="1.444733506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:04:55.443400148 +0000 UTC m=+2564.868349188" watchObservedRunningTime="2026-07-13 22:04:55.444733506 +0000 UTC m=+2564.869682546"
Jul 13 22:05:00.195137 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:00.195102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:05:04.799668 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:04.799625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:04.800174 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:04.799686    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:04.812574 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:04.812545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:05.481631 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:05.481604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:15.878732 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:15.878698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:05:36.478601 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:36.478519    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:05:40.573493 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:40.573457    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:05:41.375669 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:41.375627    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:05:42.316282 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.316245    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296774064"]
Jul 13 22:05:42.319302 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.319282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:42.321761 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.321696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lj4rk\""
Jul 13 22:05:42.323879 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.323854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296774064"]
Jul 13 22:05:42.407719 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.407672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4sxg\" (UniqueName: \"kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg\") pod \"test-curl-7424-140706296774064\" (UID: \"6485528b-9645-4561-a906-06e21aad0588\") " pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:42.508557 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.508522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4sxg\" (UniqueName: \"kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg\") pod \"test-curl-7424-140706296774064\" (UID: \"6485528b-9645-4561-a906-06e21aad0588\") " pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:42.518003 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.517968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4sxg\" (UniqueName: \"kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg\") pod \"test-curl-7424-140706296774064\" (UID: \"6485528b-9645-4561-a906-06e21aad0588\") " pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:42.630781 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.630735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:42.761858 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.761833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296774064"]
Jul 13 22:05:42.764263 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:42.764229    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6485528b_9645_4561_a906_06e21aad0588.slice/crio-f2cc78cf442d693578b42b82ac5b84c37262e354b081b84a0aa3062b1b6b675b WatchSource:0}: Error finding container f2cc78cf442d693578b42b82ac5b84c37262e354b081b84a0aa3062b1b6b675b: Status 404 returned error can't find the container with id f2cc78cf442d693578b42b82ac5b84c37262e354b081b84a0aa3062b1b6b675b
Jul 13 22:05:42.765567 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:42.765551    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 22:05:43.645871 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:43.645833    2565 generic.go:356] "Generic (PLEG): container finished" podID="6485528b-9645-4561-a906-06e21aad0588" containerID="6b715202c60e92454d99fb6c9fb3b7dba6b79c71051ff2895fdfe95870b7dbdd" exitCode=0
Jul 13 22:05:43.645871 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:43.645876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296774064" event={"ID":"6485528b-9645-4561-a906-06e21aad0588","Type":"ContainerDied","Data":"6b715202c60e92454d99fb6c9fb3b7dba6b79c71051ff2895fdfe95870b7dbdd"}
Jul 13 22:05:43.646280 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:43.645909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296774064" event={"ID":"6485528b-9645-4561-a906-06e21aad0588","Type":"ContainerStarted","Data":"f2cc78cf442d693578b42b82ac5b84c37262e354b081b84a0aa3062b1b6b675b"}
Jul 13 22:05:44.782030 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.782004    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:44.816378 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.816350    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296774064_6485528b-9645-4561-a906-06e21aad0588/test-curl-7424-140706296774064/0.log"
Jul 13 22:05:44.830650 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.830620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4sxg\" (UniqueName: \"kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg\") pod \"6485528b-9645-4561-a906-06e21aad0588\" (UID: \"6485528b-9645-4561-a906-06e21aad0588\") "
Jul 13 22:05:44.832766 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.832736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg" (OuterVolumeSpecName: "kube-api-access-v4sxg") pod "6485528b-9645-4561-a906-06e21aad0588" (UID: "6485528b-9645-4561-a906-06e21aad0588"). InnerVolumeSpecName "kube-api-access-v4sxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:44.839290 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.839266    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296774064"]
Jul 13 22:05:44.841988 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.841968    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296774064"]
Jul 13 22:05:44.932125 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.932034    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4sxg\" (UniqueName: \"kubernetes.io/projected/6485528b-9645-4561-a906-06e21aad0588-kube-api-access-v4sxg\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:44.955854 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.955808    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296770864"]
Jul 13 22:05:44.956224 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.956205    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6485528b-9645-4561-a906-06e21aad0588" containerName="test-curl-7424-140706296774064"
Jul 13 22:05:44.956307 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.956227    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6485528b-9645-4561-a906-06e21aad0588" containerName="test-curl-7424-140706296774064"
Jul 13 22:05:44.956365 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.956330    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6485528b-9645-4561-a906-06e21aad0588" containerName="test-curl-7424-140706296774064"
Jul 13 22:05:44.959069 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.959050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:44.964931 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:44.964904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296770864"]
Jul 13 22:05:45.033070 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.033031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhqs\" (UniqueName: \"kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs\") pod \"test-curl-7424-140706296770864\" (UID: \"2a1d4ba0-deed-41c6-b233-771f287236da\") " pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:45.134383 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.134333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhqs\" (UniqueName: \"kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs\") pod \"test-curl-7424-140706296770864\" (UID: \"2a1d4ba0-deed-41c6-b233-771f287236da\") " pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:45.141974 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.141950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhqs\" (UniqueName: \"kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs\") pod \"test-curl-7424-140706296770864\" (UID: \"2a1d4ba0-deed-41c6-b233-771f287236da\") " pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:45.174940 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.170247    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6485528b-9645-4561-a906-06e21aad0588" path="/var/lib/kubelet/pods/6485528b-9645-4561-a906-06e21aad0588/volumes"
Jul 13 22:05:45.269678 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.269579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:45.405340 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.405314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296770864"]
Jul 13 22:05:45.407819 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:45.407769    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a1d4ba0_deed_41c6_b233_771f287236da.slice/crio-13829b46ec89d133cee06747277add09c1eda6329688abaef2c8f4e1c32c89d3 WatchSource:0}: Error finding container 13829b46ec89d133cee06747277add09c1eda6329688abaef2c8f4e1c32c89d3: Status 404 returned error can't find the container with id 13829b46ec89d133cee06747277add09c1eda6329688abaef2c8f4e1c32c89d3
Jul 13 22:05:45.655378 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.655349    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296774064"
Jul 13 22:05:45.655378 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.655380    2565 scope.go:117] "RemoveContainer" containerID="6b715202c60e92454d99fb6c9fb3b7dba6b79c71051ff2895fdfe95870b7dbdd"
Jul 13 22:05:45.656994 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:45.656968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296770864" event={"ID":"2a1d4ba0-deed-41c6-b233-771f287236da","Type":"ContainerStarted","Data":"13829b46ec89d133cee06747277add09c1eda6329688abaef2c8f4e1c32c89d3"}
Jul 13 22:05:46.663550 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:46.663511    2565 generic.go:356] "Generic (PLEG): container finished" podID="2a1d4ba0-deed-41c6-b233-771f287236da" containerID="e4c65388fc64339a07fca1ef754b49cd9c7cf2da74d24d53add94a1897bdf03a" exitCode=0
Jul 13 22:05:46.663550 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:46.663552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296770864" event={"ID":"2a1d4ba0-deed-41c6-b233-771f287236da","Type":"ContainerDied","Data":"e4c65388fc64339a07fca1ef754b49cd9c7cf2da74d24d53add94a1897bdf03a"}
Jul 13 22:05:47.800277 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.800247    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:47.821151 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.821110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296770864_2a1d4ba0-deed-41c6-b233-771f287236da/test-curl-7424-140706296770864/0.log"
Jul 13 22:05:47.842396 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.842364    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296770864"]
Jul 13 22:05:47.848457 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.848426    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296770864"]
Jul 13 22:05:47.858130 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.858106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwhqs\" (UniqueName: \"kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs\") pod \"2a1d4ba0-deed-41c6-b233-771f287236da\" (UID: \"2a1d4ba0-deed-41c6-b233-771f287236da\") "
Jul 13 22:05:47.860179 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.860152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs" (OuterVolumeSpecName: "kube-api-access-bwhqs") pod "2a1d4ba0-deed-41c6-b233-771f287236da" (UID: "2a1d4ba0-deed-41c6-b233-771f287236da"). InnerVolumeSpecName "kube-api-access-bwhqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:47.959411 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.959320    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwhqs\" (UniqueName: \"kubernetes.io/projected/2a1d4ba0-deed-41c6-b233-771f287236da-kube-api-access-bwhqs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:47.998921 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.998885    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:47.999209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.999196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1d4ba0-deed-41c6-b233-771f287236da" containerName="test-curl-7424-140706296770864"
Jul 13 22:05:47.999253 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.999210    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1d4ba0-deed-41c6-b233-771f287236da" containerName="test-curl-7424-140706296770864"
Jul 13 22:05:47.999285 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:47.999275    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1d4ba0-deed-41c6-b233-771f287236da" containerName="test-curl-7424-140706296770864"
Jul 13 22:05:48.002275 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.002254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:48.007063 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.007034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:48.060186 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.060145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8fft\" (UniqueName: \"kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft\") pod \"test-curl-7424-140706296677264\" (UID: \"0b424c7d-37fe-4bbb-a180-4148d7a00f89\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:48.160932 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.160894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8fft\" (UniqueName: \"kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft\") pod \"test-curl-7424-140706296677264\" (UID: \"0b424c7d-37fe-4bbb-a180-4148d7a00f89\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:48.169185 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.169148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8fft\" (UniqueName: \"kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft\") pod \"test-curl-7424-140706296677264\" (UID: \"0b424c7d-37fe-4bbb-a180-4148d7a00f89\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:48.312744 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.312651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:48.444474 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.444440    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:48.447375 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:48.447346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b424c7d_37fe_4bbb_a180_4148d7a00f89.slice/crio-3d227acd34b193f9ea0ec1099b003e1f091629c05348a11fcecc96241c9ff45f WatchSource:0}: Error finding container 3d227acd34b193f9ea0ec1099b003e1f091629c05348a11fcecc96241c9ff45f: Status 404 returned error can't find the container with id 3d227acd34b193f9ea0ec1099b003e1f091629c05348a11fcecc96241c9ff45f
Jul 13 22:05:48.675057 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.675030    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:48.675258 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.675067    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13829b46ec89d133cee06747277add09c1eda6329688abaef2c8f4e1c32c89d3"
Jul 13 22:05:48.676247 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:48.676223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296677264" event={"ID":"0b424c7d-37fe-4bbb-a180-4148d7a00f89","Type":"ContainerStarted","Data":"3d227acd34b193f9ea0ec1099b003e1f091629c05348a11fcecc96241c9ff45f"}
Jul 13 22:05:48.685618 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:05:48.685592    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7424-140706296770864\" is forbidden: User \"system:node:ip-10-0-136-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-49.ec2.internal' and this object" podUID="2a1d4ba0-deed-41c6-b233-771f287236da" pod="opendatahub/test-curl-7424-140706296770864"
Jul 13 22:05:49.169151 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:49.169119    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1d4ba0-deed-41c6-b233-771f287236da" path="/var/lib/kubelet/pods/2a1d4ba0-deed-41c6-b233-771f287236da/volumes"
Jul 13 22:05:49.682228 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:49.682185    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b424c7d-37fe-4bbb-a180-4148d7a00f89" containerID="8bbc62b0ce9a25d828ba44b5e0b82ddfbbf38702f9e8540943a0aea3446cd633" exitCode=0
Jul 13 22:05:49.682425 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:49.682271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296677264" event={"ID":"0b424c7d-37fe-4bbb-a180-4148d7a00f89","Type":"ContainerDied","Data":"8bbc62b0ce9a25d828ba44b5e0b82ddfbbf38702f9e8540943a0aea3446cd633"}
Jul 13 22:05:50.808346 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.808321    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:50.828709 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.828673    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296677264_0b424c7d-37fe-4bbb-a180-4148d7a00f89/test-curl-7424-140706296677264/0.log"
Jul 13 22:05:50.849819 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.849778    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:50.853281 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.853257    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:50.884958 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.884934    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8fft\" (UniqueName: \"kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft\") pod \"0b424c7d-37fe-4bbb-a180-4148d7a00f89\" (UID: \"0b424c7d-37fe-4bbb-a180-4148d7a00f89\") "
Jul 13 22:05:50.887018 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.886996    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft" (OuterVolumeSpecName: "kube-api-access-j8fft") pod "0b424c7d-37fe-4bbb-a180-4148d7a00f89" (UID: "0b424c7d-37fe-4bbb-a180-4148d7a00f89"). InnerVolumeSpecName "kube-api-access-j8fft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:50.962414 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.962334    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:50.962700 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.962687    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b424c7d-37fe-4bbb-a180-4148d7a00f89" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:50.962744 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.962702    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b424c7d-37fe-4bbb-a180-4148d7a00f89" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:50.962775 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.962760    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b424c7d-37fe-4bbb-a180-4148d7a00f89" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:50.965596 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.965581    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:50.969620 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.969596    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:50.985711 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:50.985686    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8fft\" (UniqueName: \"kubernetes.io/projected/0b424c7d-37fe-4bbb-a180-4148d7a00f89-kube-api-access-j8fft\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:51.086170 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.086134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqk45\" (UniqueName: \"kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45\") pod \"test-curl-7424-140706296677264\" (UID: \"bcc70f2c-4266-47de-9db4-71458113ae49\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:51.169131 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.169100    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b424c7d-37fe-4bbb-a180-4148d7a00f89" path="/var/lib/kubelet/pods/0b424c7d-37fe-4bbb-a180-4148d7a00f89/volumes"
Jul 13 22:05:51.186863 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.186838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqk45\" (UniqueName: \"kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45\") pod \"test-curl-7424-140706296677264\" (UID: \"bcc70f2c-4266-47de-9db4-71458113ae49\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:51.195161 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.195132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqk45\" (UniqueName: \"kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45\") pod \"test-curl-7424-140706296677264\" (UID: \"bcc70f2c-4266-47de-9db4-71458113ae49\") " pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:51.276136 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.276049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:51.405188 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.405162    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:51.407170 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:51.407137    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcc70f2c_4266_47de_9db4_71458113ae49.slice/crio-1d3bf30f45ebf7336baabf146089867a7b2646ea4c11433351dcd762ee591470 WatchSource:0}: Error finding container 1d3bf30f45ebf7336baabf146089867a7b2646ea4c11433351dcd762ee591470: Status 404 returned error can't find the container with id 1d3bf30f45ebf7336baabf146089867a7b2646ea4c11433351dcd762ee591470
Jul 13 22:05:51.692279 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.692235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296677264" event={"ID":"bcc70f2c-4266-47de-9db4-71458113ae49","Type":"ContainerStarted","Data":"1d3bf30f45ebf7336baabf146089867a7b2646ea4c11433351dcd762ee591470"}
Jul 13 22:05:51.693542 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.693523    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:51.693675 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:51.693562    2565 scope.go:117] "RemoveContainer" containerID="8bbc62b0ce9a25d828ba44b5e0b82ddfbbf38702f9e8540943a0aea3446cd633"
Jul 13 22:05:52.475043 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:52.475006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:05:52.699578 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:52.699548    2565 generic.go:356] "Generic (PLEG): container finished" podID="bcc70f2c-4266-47de-9db4-71458113ae49" containerID="49ec3ab18abcfbe8ec81459fdc04e814ccd28cc40b11c13556825f6313fac43c" exitCode=0
Jul 13 22:05:52.699777 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:52.699638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296677264" event={"ID":"bcc70f2c-4266-47de-9db4-71458113ae49","Type":"ContainerDied","Data":"49ec3ab18abcfbe8ec81459fdc04e814ccd28cc40b11c13556825f6313fac43c"}
Jul 13 22:05:53.839216 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.839191    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:53.859034 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.859008    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296677264_bcc70f2c-4266-47de-9db4-71458113ae49/test-curl-7424-140706296677264/0.log"
Jul 13 22:05:53.882019 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.881987    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:53.889634 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.889601    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296677264"]
Jul 13 22:05:53.911272 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.911243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqk45\" (UniqueName: \"kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45\") pod \"bcc70f2c-4266-47de-9db4-71458113ae49\" (UID: \"bcc70f2c-4266-47de-9db4-71458113ae49\") "
Jul 13 22:05:53.913311 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:53.913283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45" (OuterVolumeSpecName: "kube-api-access-xqk45") pod "bcc70f2c-4266-47de-9db4-71458113ae49" (UID: "bcc70f2c-4266-47de-9db4-71458113ae49"). InnerVolumeSpecName "kube-api-access-xqk45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:54.009704 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.009619    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:54.010005 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.009989    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc70f2c-4266-47de-9db4-71458113ae49" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:54.010055 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.010007    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc70f2c-4266-47de-9db4-71458113ae49" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:54.010089 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.010057    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc70f2c-4266-47de-9db4-71458113ae49" containerName="test-curl-7424-140706296677264"
Jul 13 22:05:54.012370 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.012339    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqk45\" (UniqueName: \"kubernetes.io/projected/bcc70f2c-4266-47de-9db4-71458113ae49-kube-api-access-xqk45\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:54.012924 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.012906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:54.019629 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.019549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:54.113219 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.113175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8ql\" (UniqueName: \"kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql\") pod \"test-curl-7424-140706296678704\" (UID: \"5e62bfe1-b212-4145-bd16-b3ada4232fcb\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:54.214667 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.214622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8ql\" (UniqueName: \"kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql\") pod \"test-curl-7424-140706296678704\" (UID: \"5e62bfe1-b212-4145-bd16-b3ada4232fcb\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:54.223164 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.223140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8ql\" (UniqueName: \"kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql\") pod \"test-curl-7424-140706296678704\" (UID: \"5e62bfe1-b212-4145-bd16-b3ada4232fcb\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:54.322830 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.322702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:54.658621 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.658585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:54.661694 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:54.661666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e62bfe1_b212_4145_bd16_b3ada4232fcb.slice/crio-f8c64679d71eb2ddea290fd40d6d3f2f598553e7fb155165c518e889dfa68826 WatchSource:0}: Error finding container f8c64679d71eb2ddea290fd40d6d3f2f598553e7fb155165c518e889dfa68826: Status 404 returned error can't find the container with id f8c64679d71eb2ddea290fd40d6d3f2f598553e7fb155165c518e889dfa68826
Jul 13 22:05:54.710897 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.710866    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:54.710897 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.710893    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d3bf30f45ebf7336baabf146089867a7b2646ea4c11433351dcd762ee591470"
Jul 13 22:05:54.712121 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:54.712095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296678704" event={"ID":"5e62bfe1-b212-4145-bd16-b3ada4232fcb","Type":"ContainerStarted","Data":"f8c64679d71eb2ddea290fd40d6d3f2f598553e7fb155165c518e889dfa68826"}
Jul 13 22:05:54.727493 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:05:54.727462    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7424-140706296677264\" is forbidden: User \"system:node:ip-10-0-136-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-49.ec2.internal' and this object" podUID="bcc70f2c-4266-47de-9db4-71458113ae49" pod="opendatahub/test-curl-7424-140706296677264"
Jul 13 22:05:55.169144 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.169109    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc70f2c-4266-47de-9db4-71458113ae49" path="/var/lib/kubelet/pods/bcc70f2c-4266-47de-9db4-71458113ae49/volumes"
Jul 13 22:05:55.593660 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.593602    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" podUID="18bf5878-8795-4e87-bc95-b6fa5a398d80" containerName="main" containerID="cri-o://62087d489c792d7cfaf58004b543c8e5bb2549d6307435d8d79338864be325f5" gracePeriod=45
Jul 13 22:05:55.718568 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.718541    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e62bfe1-b212-4145-bd16-b3ada4232fcb" containerID="d4480518789078625ac0179ae03d218c3a03b5076249134a89c0bebc6e835fe4" exitCode=0
Jul 13 22:05:55.718696 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.718624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296678704" event={"ID":"5e62bfe1-b212-4145-bd16-b3ada4232fcb","Type":"ContainerDied","Data":"d4480518789078625ac0179ae03d218c3a03b5076249134a89c0bebc6e835fe4"}
Jul 13 22:05:55.720071 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.720052    2565 generic.go:356] "Generic (PLEG): container finished" podID="18bf5878-8795-4e87-bc95-b6fa5a398d80" containerID="62087d489c792d7cfaf58004b543c8e5bb2549d6307435d8d79338864be325f5" exitCode=0
Jul 13 22:05:55.720172 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.720085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" event={"ID":"18bf5878-8795-4e87-bc95-b6fa5a398d80","Type":"ContainerDied","Data":"62087d489c792d7cfaf58004b543c8e5bb2549d6307435d8d79338864be325f5"}
Jul 13 22:05:55.862749 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.862725    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:05:55.927509 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927674 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927674 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927843 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927843 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2ll7\" (UniqueName: \"kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927843 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir\") pod \"18bf5878-8795-4e87-bc95-b6fa5a398d80\" (UID: \"18bf5878-8795-4e87-bc95-b6fa5a398d80\") "
Jul 13 22:05:55.927984 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927880    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home" (OuterVolumeSpecName: "home") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:55.927984 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.927919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache" (OuterVolumeSpecName: "model-cache") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:55.928068 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.928049    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:55.928105 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.928065    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:55.928105 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.928083    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:55.929701 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.929677    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm" (OuterVolumeSpecName: "dshm") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:55.929827 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.929702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:05:55.929827 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:55.929744    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7" (OuterVolumeSpecName: "kube-api-access-n2ll7") pod "18bf5878-8795-4e87-bc95-b6fa5a398d80" (UID: "18bf5878-8795-4e87-bc95-b6fa5a398d80"). InnerVolumeSpecName "kube-api-access-n2ll7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:56.029014 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.028977    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bf5878-8795-4e87-bc95-b6fa5a398d80-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.029014 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.029005    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.029014 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.029014    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2ll7\" (UniqueName: \"kubernetes.io/projected/18bf5878-8795-4e87-bc95-b6fa5a398d80-kube-api-access-n2ll7\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.029014 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.029023    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bf5878-8795-4e87-bc95-b6fa5a398d80-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.400533 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.400492    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" podUID="e23074d8-4f00-408f-9e18-7d09ca008ae4" containerName="main" containerID="cri-o://eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172" gracePeriod=45
Jul 13 22:05:56.636353 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.636325    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:56.726322 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.726228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"
Jul 13 22:05:56.726322 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.726269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx" event={"ID":"18bf5878-8795-4e87-bc95-b6fa5a398d80","Type":"ContainerDied","Data":"785585a5994846ec2c0e34e0854028546ca0baab7201f1395d721b4b9abf2fa1"}
Jul 13 22:05:56.726322 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.726316    2565 scope.go:117] "RemoveContainer" containerID="62087d489c792d7cfaf58004b543c8e5bb2549d6307435d8d79338864be325f5"
Jul 13 22:05:56.727645 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.727623    2565 generic.go:356] "Generic (PLEG): container finished" podID="e23074d8-4f00-408f-9e18-7d09ca008ae4" containerID="eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172" exitCode=0
Jul 13 22:05:56.727737 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.727656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" event={"ID":"e23074d8-4f00-408f-9e18-7d09ca008ae4","Type":"ContainerDied","Data":"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"}
Jul 13 22:05:56.727737 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.727669    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"
Jul 13 22:05:56.727737 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.727694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk" event={"ID":"e23074d8-4f00-408f-9e18-7d09ca008ae4","Type":"ContainerDied","Data":"989a7e42d7c8a47cb3db95a2697179580136140faad1fb377f33980429f13e9b"}
Jul 13 22:05:56.735665 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.735641    2565 scope.go:117] "RemoveContainer" containerID="eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"
Jul 13 22:05:56.735810 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.735766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfdrn\" (UniqueName: \"kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.735877 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.735844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.735941 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.735905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.735998 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.735965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.736054 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.736054 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm\") pod \"e23074d8-4f00-408f-9e18-7d09ca008ae4\" (UID: \"e23074d8-4f00-408f-9e18-7d09ca008ae4\") "
Jul 13 22:05:56.736152 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:56.736209 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home" (OuterVolumeSpecName: "home") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:56.736323 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache" (OuterVolumeSpecName: "model-cache") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:56.736426 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736361    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-tmp-dir\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.736426 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.736381    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-home\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.738617 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.738595    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:05:56.738617 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.738605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm" (OuterVolumeSpecName: "dshm") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:05:56.738753 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.738740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn" (OuterVolumeSpecName: "kube-api-access-pfdrn") pod "e23074d8-4f00-408f-9e18-7d09ca008ae4" (UID: "e23074d8-4f00-408f-9e18-7d09ca008ae4"). InnerVolumeSpecName "kube-api-access-pfdrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:56.744920 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.744897    2565 scope.go:117] "RemoveContainer" containerID="eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"
Jul 13 22:05:56.745265 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:05:56.745248    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172\": container with ID starting with eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172 not found: ID does not exist" containerID="eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"
Jul 13 22:05:56.745330 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.745274    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172"} err="failed to get container status \"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172\": rpc error: code = NotFound desc = could not find container \"eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172\": container with ID starting with eeb34e5b687154aaf10b066bea3098920ded72f31f1f4b7aff2407cfa31f5172 not found: ID does not exist"
Jul 13 22:05:56.747586 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.747563    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:05:56.755224 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.755200    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44ef67/rate-test-model-44ef67-kserve-64c789d68c-n8zdx"]
Jul 13 22:05:56.837142 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.837094    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfdrn\" (UniqueName: \"kubernetes.io/projected/e23074d8-4f00-408f-9e18-7d09ca008ae4-kube-api-access-pfdrn\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.837142 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.837126    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e23074d8-4f00-408f-9e18-7d09ca008ae4-tls-certs\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.837142 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.837138    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-model-cache\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.837142 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.837146    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e23074d8-4f00-408f-9e18-7d09ca008ae4-dshm\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:56.868107 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.868080    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:56.888960 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.888932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296678704_5e62bfe1-b212-4145-bd16-b3ada4232fcb/test-curl-7424-140706296678704/0.log"
Jul 13 22:05:56.914608 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.914567    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:56.918845 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.918817    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:56.937522 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.937487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f8ql\" (UniqueName: \"kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql\") pod \"5e62bfe1-b212-4145-bd16-b3ada4232fcb\" (UID: \"5e62bfe1-b212-4145-bd16-b3ada4232fcb\") "
Jul 13 22:05:56.939588 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:56.939562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql" (OuterVolumeSpecName: "kube-api-access-9f8ql") pod "5e62bfe1-b212-4145-bd16-b3ada4232fcb" (UID: "5e62bfe1-b212-4145-bd16-b3ada4232fcb"). InnerVolumeSpecName "kube-api-access-9f8ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:05:57.038373 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.038346    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f8ql\" (UniqueName: \"kubernetes.io/projected/5e62bfe1-b212-4145-bd16-b3ada4232fcb-kube-api-access-9f8ql\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:05:57.040497 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040471    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:57.040845 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040830    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bf5878-8795-4e87-bc95-b6fa5a398d80" containerName="main"
Jul 13 22:05:57.040885 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040847    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bf5878-8795-4e87-bc95-b6fa5a398d80" containerName="main"
Jul 13 22:05:57.040885 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040858    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e62bfe1-b212-4145-bd16-b3ada4232fcb" containerName="test-curl-7424-140706296678704"
Jul 13 22:05:57.040885 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e62bfe1-b212-4145-bd16-b3ada4232fcb" containerName="test-curl-7424-140706296678704"
Jul 13 22:05:57.040885 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040875    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23074d8-4f00-408f-9e18-7d09ca008ae4" containerName="main"
Jul 13 22:05:57.040885 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040881    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23074d8-4f00-408f-9e18-7d09ca008ae4" containerName="main"
Jul 13 22:05:57.041046 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040936    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bf5878-8795-4e87-bc95-b6fa5a398d80" containerName="main"
Jul 13 22:05:57.041046 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040943    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23074d8-4f00-408f-9e18-7d09ca008ae4" containerName="main"
Jul 13 22:05:57.041046 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.040951    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e62bfe1-b212-4145-bd16-b3ada4232fcb" containerName="test-curl-7424-140706296678704"
Jul 13 22:05:57.043881 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.043863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.048521 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.048470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:57.052919 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.052894    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:05:57.059174 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.059150    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f0e328/rate-test-model-f0e328-kserve-6855cb77c9-t79rk"]
Jul 13 22:05:57.138714 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.138681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psqgc\" (UniqueName: \"kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc\") pod \"test-curl-7424-140706296678704\" (UID: \"335ac8f1-2620-40a2-8a9f-385622bd1194\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.169649 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.169619    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18bf5878-8795-4e87-bc95-b6fa5a398d80" path="/var/lib/kubelet/pods/18bf5878-8795-4e87-bc95-b6fa5a398d80/volumes"
Jul 13 22:05:57.170042 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.170027    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e62bfe1-b212-4145-bd16-b3ada4232fcb" path="/var/lib/kubelet/pods/5e62bfe1-b212-4145-bd16-b3ada4232fcb/volumes"
Jul 13 22:05:57.170412 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.170399    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23074d8-4f00-408f-9e18-7d09ca008ae4" path="/var/lib/kubelet/pods/e23074d8-4f00-408f-9e18-7d09ca008ae4/volumes"
Jul 13 22:05:57.239841 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.239768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psqgc\" (UniqueName: \"kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc\") pod \"test-curl-7424-140706296678704\" (UID: \"335ac8f1-2620-40a2-8a9f-385622bd1194\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.248186 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.248151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psqgc\" (UniqueName: \"kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc\") pod \"test-curl-7424-140706296678704\" (UID: \"335ac8f1-2620-40a2-8a9f-385622bd1194\") " pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.354502 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.354470    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.488179 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.488149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:57.490455 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:05:57.490417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod335ac8f1_2620_40a2_8a9f_385622bd1194.slice/crio-25fa9706ce30652e7a9d44c64e3b7eecaf694fb75265bf48f8c4c897e17715e2 WatchSource:0}: Error finding container 25fa9706ce30652e7a9d44c64e3b7eecaf694fb75265bf48f8c4c897e17715e2: Status 404 returned error can't find the container with id 25fa9706ce30652e7a9d44c64e3b7eecaf694fb75265bf48f8c4c897e17715e2
Jul 13 22:05:57.733829 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.733729    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:57.733829 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.733737    2565 scope.go:117] "RemoveContainer" containerID="d4480518789078625ac0179ae03d218c3a03b5076249134a89c0bebc6e835fe4"
Jul 13 22:05:57.735955 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:57.735922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296678704" event={"ID":"335ac8f1-2620-40a2-8a9f-385622bd1194","Type":"ContainerStarted","Data":"25fa9706ce30652e7a9d44c64e3b7eecaf694fb75265bf48f8c4c897e17715e2"}
Jul 13 22:05:58.744133 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:58.744104    2565 generic.go:356] "Generic (PLEG): container finished" podID="335ac8f1-2620-40a2-8a9f-385622bd1194" containerID="5c4ec60a9479abe842699b80a418e67fd92f962c83d0d4c75fe6912a0ddf175a" exitCode=0
Jul 13 22:05:58.744539 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:58.744155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7424-140706296678704" event={"ID":"335ac8f1-2620-40a2-8a9f-385622bd1194","Type":"ContainerDied","Data":"5c4ec60a9479abe842699b80a418e67fd92f962c83d0d4c75fe6912a0ddf175a"}
Jul 13 22:05:59.884445 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.884419    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:05:59.904834 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.904781    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7424-140706296678704_335ac8f1-2620-40a2-8a9f-385622bd1194/test-curl-7424-140706296678704/0.log"
Jul 13 22:05:59.928548 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.928515    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:59.933527 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.933501    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7424-140706296678704"]
Jul 13 22:05:59.965201 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.965171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psqgc\" (UniqueName: \"kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc\") pod \"335ac8f1-2620-40a2-8a9f-385622bd1194\" (UID: \"335ac8f1-2620-40a2-8a9f-385622bd1194\") "
Jul 13 22:05:59.967239 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:05:59.967205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc" (OuterVolumeSpecName: "kube-api-access-psqgc") pod "335ac8f1-2620-40a2-8a9f-385622bd1194" (UID: "335ac8f1-2620-40a2-8a9f-385622bd1194"). InnerVolumeSpecName "kube-api-access-psqgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:00.066647 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:00.066548    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psqgc\" (UniqueName: \"kubernetes.io/projected/335ac8f1-2620-40a2-8a9f-385622bd1194-kube-api-access-psqgc\") on node \"ip-10-0-136-49.ec2.internal\" DevicePath \"\""
Jul 13 22:06:00.755606 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:00.755573    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25fa9706ce30652e7a9d44c64e3b7eecaf694fb75265bf48f8c4c897e17715e2"
Jul 13 22:06:00.755606 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:00.755609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:06:00.765260 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:06:00.765225    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7424-140706296678704\" is forbidden: User \"system:node:ip-10-0-136-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-49.ec2.internal' and this object" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:06:01.167920 ip-10-0-136-49 kubenswrapper[2565]: E0713 22:06:01.167887    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7424-140706296678704\" is forbidden: User \"system:node:ip-10-0-136-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-49.ec2.internal' and this object" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" pod="opendatahub/test-curl-7424-140706296678704"
Jul 13 22:06:01.169680 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:01.169652    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" path="/var/lib/kubelet/pods/335ac8f1-2620-40a2-8a9f-385622bd1194/volumes"
Jul 13 22:06:14.176360 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:14.176322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:06:40.307592 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:40.307551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4wqd9"]
Jul 13 22:06:52.783515 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:52.783483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f896f5c76-cdxhc_5b559d49-c9c2-49ff-a3f0-1b6d026a409d/authorino/0.log"
Jul 13 22:06:58.492053 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:58.492021    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-hn4qq_400afb64-3517-43ab-baff-efd22155a74f/copy-manifests/0.log"
Jul 13 22:06:58.500163 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:06:58.500135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-hn4qq_400afb64-3517-43ab-baff-efd22155a74f/manager/0.log"
Jul 13 22:07:02.036361 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:02.036329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f896f5c76-cdxhc_5b559d49-c9c2-49ff-a3f0-1b6d026a409d/authorino/0.log"
Jul 13 22:07:02.152339 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:02.152265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hrhs6_872f25d7-a647-4d4d-a5e2-965d9050fedc/manager/0.log"
Jul 13 22:07:02.722622 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:02.722587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4wqd9_479f9632-8422-406c-9832-0e07e1c761f4/limitador/0.log"
Jul 13 22:07:03.408749 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:03.408716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6964b4f475-jbbw4_da8125f7-82f3-4401-81e0-8dfa282263c9/kube-auth-proxy/0.log"
Jul 13 22:07:04.870708 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:04.870673    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-774mg_96a262ff-3faa-41e9-952c-ccdc3ec4c080/main/0.log"
Jul 13 22:07:08.815440 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.815399    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jl7zj/must-gather-2tcmw"]
Jul 13 22:07:08.816148 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.815715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" containerName="test-curl-7424-140706296678704"
Jul 13 22:07:08.816148 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.815726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" containerName="test-curl-7424-140706296678704"
Jul 13 22:07:08.816148 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.815817    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="335ac8f1-2620-40a2-8a9f-385622bd1194" containerName="test-curl-7424-140706296678704"
Jul 13 22:07:08.819007 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.818989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.822105 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.822078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jl7zj\"/\"openshift-service-ca.crt\""
Jul 13 22:07:08.822865 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.822847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jl7zj\"/\"kube-root-ca.crt\""
Jul 13 22:07:08.822968 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.822869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jl7zj\"/\"default-dockercfg-qtxmd\""
Jul 13 22:07:08.829900 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.829870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/must-gather-2tcmw"]
Jul 13 22:07:08.870613 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.870573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79r5m\" (UniqueName: \"kubernetes.io/projected/c66366b3-0073-4661-a344-112076cbeb25-kube-api-access-79r5m\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.870834 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.870682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66366b3-0073-4661-a344-112076cbeb25-must-gather-output\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.972146 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.972101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79r5m\" (UniqueName: \"kubernetes.io/projected/c66366b3-0073-4661-a344-112076cbeb25-kube-api-access-79r5m\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.972328 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.972184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66366b3-0073-4661-a344-112076cbeb25-must-gather-output\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.972481 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.972466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66366b3-0073-4661-a344-112076cbeb25-must-gather-output\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:08.981841 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:08.981806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79r5m\" (UniqueName: \"kubernetes.io/projected/c66366b3-0073-4661-a344-112076cbeb25-kube-api-access-79r5m\") pod \"must-gather-2tcmw\" (UID: \"c66366b3-0073-4661-a344-112076cbeb25\") " pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:09.128660 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:09.128622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/must-gather-2tcmw"
Jul 13 22:07:09.266423 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:09.266388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/must-gather-2tcmw"]
Jul 13 22:07:09.269132 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:07:09.269102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc66366b3_0073_4661_a344_112076cbeb25.slice/crio-5770c3085b9234fbea03a6c1ba3a815da472627c7df2733aa44afa970183eb69 WatchSource:0}: Error finding container 5770c3085b9234fbea03a6c1ba3a815da472627c7df2733aa44afa970183eb69: Status 404 returned error can't find the container with id 5770c3085b9234fbea03a6c1ba3a815da472627c7df2733aa44afa970183eb69
Jul 13 22:07:10.066038 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:10.065996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/must-gather-2tcmw" event={"ID":"c66366b3-0073-4661-a344-112076cbeb25","Type":"ContainerStarted","Data":"5770c3085b9234fbea03a6c1ba3a815da472627c7df2733aa44afa970183eb69"}
Jul 13 22:07:11.076186 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.076139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/must-gather-2tcmw" event={"ID":"c66366b3-0073-4661-a344-112076cbeb25","Type":"ContainerStarted","Data":"2e5aace811544be6b430ffeb83bd85a5525cd66b9b9dac99fa23876091df0362"}
Jul 13 22:07:11.076684 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.076200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/must-gather-2tcmw" event={"ID":"c66366b3-0073-4661-a344-112076cbeb25","Type":"ContainerStarted","Data":"671f538bf367d1b56ff6826451509c3f1010c634232b8b66da8af3bd92ae5899"}
Jul 13 22:07:11.095840 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.094639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jl7zj/must-gather-2tcmw" podStartSLOduration=2.184043902 podStartE2EDuration="3.094616413s" totalImagesPullingTime="910.572511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:07:11.092565647 +0000 UTC m=+2700.517514689" watchObservedRunningTime="2026-07-13 22:07:11.094616413 +0000 UTC m=+2700.519565456"
Jul 13 22:07:11.252510 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.252480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 22:07:11.254909 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.254878    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bdzr_91d948eb-ef4a-4fa3-b0a2-9919ea6c6223/ovn-acl-logging/0.log"
Jul 13 22:07:11.883139 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.883102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wq8dc_a57d9cf8-0780-4a6b-b71b-f0751418d02c/global-pull-secret-syncer/0.log"
Jul 13 22:07:11.987756 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:11.987721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8kzp5_c011349c-0d8c-4311-86c1-cbc3fe77fe10/konnectivity-agent/0.log"
Jul 13 22:07:12.074137 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:12.074106    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-49.ec2.internal_af6932374b5d843067eb5a100f1bbb82/haproxy/0.log"
Jul 13 22:07:17.417150 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:17.417113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f896f5c76-cdxhc_5b559d49-c9c2-49ff-a3f0-1b6d026a409d/authorino/0.log"
Jul 13 22:07:17.530183 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:17.529925    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hrhs6_872f25d7-a647-4d4d-a5e2-965d9050fedc/manager/0.log"
Jul 13 22:07:17.905048 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:17.904957    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4wqd9_479f9632-8422-406c-9832-0e07e1c761f4/limitador/0.log"
Jul 13 22:07:20.104317 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.104283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kpxpw_4e2ead2f-97bf-447e-b3f1-1f6b122d9c10/kube-state-metrics/0.log"
Jul 13 22:07:20.127720 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.127686    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kpxpw_4e2ead2f-97bf-447e-b3f1-1f6b122d9c10/kube-rbac-proxy-main/0.log"
Jul 13 22:07:20.159848 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.159820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kpxpw_4e2ead2f-97bf-447e-b3f1-1f6b122d9c10/kube-rbac-proxy-self/0.log"
Jul 13 22:07:20.449341 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.449309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkm6_65b846a6-f661-404b-a297-6de1c4b3c44a/node-exporter/0.log"
Jul 13 22:07:20.492560 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.492524    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkm6_65b846a6-f661-404b-a297-6de1c4b3c44a/kube-rbac-proxy/0.log"
Jul 13 22:07:20.527608 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.527562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkm6_65b846a6-f661-404b-a297-6de1c4b3c44a/init-textfile/0.log"
Jul 13 22:07:20.694550 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.694517    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/prometheus/0.log"
Jul 13 22:07:20.719943 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.719914    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/config-reloader/0.log"
Jul 13 22:07:20.747956 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.747924    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/thanos-sidecar/0.log"
Jul 13 22:07:20.783084 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.783052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/kube-rbac-proxy-web/0.log"
Jul 13 22:07:20.809809 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.809764    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/kube-rbac-proxy/0.log"
Jul 13 22:07:20.833723 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.833692    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/kube-rbac-proxy-thanos/0.log"
Jul 13 22:07:20.856657 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:20.856607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ffa70d4-24b6-4b05-8792-d7b4cb3f962e/init-config-reloader/0.log"
Jul 13 22:07:21.034548 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.034456    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/thanos-query/0.log"
Jul 13 22:07:21.055011 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.054984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/kube-rbac-proxy-web/0.log"
Jul 13 22:07:21.078663 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.078630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/kube-rbac-proxy/0.log"
Jul 13 22:07:21.101151 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.101122    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/prom-label-proxy/0.log"
Jul 13 22:07:21.122897 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.122862    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/kube-rbac-proxy-rules/0.log"
Jul 13 22:07:21.143882 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.143848    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f9b9fb79-dzn67_9ab7ed95-501d-47fd-b3f0-6bd1c90dc48a/kube-rbac-proxy-metrics/0.log"
Jul 13 22:07:21.853239 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.853176    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"]
Jul 13 22:07:21.859201 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.859170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:21.863998 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.863968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"]
Jul 13 22:07:21.910307 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.910259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-podres\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:21.910685 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.910662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-lib-modules\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:21.910860 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.910843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-proc\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:21.911018 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.911002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vx7\" (UniqueName: \"kubernetes.io/projected/58446c96-e1c9-4469-ac22-f6136696198e-kube-api-access-j5vx7\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:21.911140 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:21.911127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-sys\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012089 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-sys\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012271 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-podres\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012271 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-sys\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012271 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-lib-modules\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012271 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-proc\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012552 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-podres\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012552 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vx7\" (UniqueName: \"kubernetes.io/projected/58446c96-e1c9-4469-ac22-f6136696198e-kube-api-access-j5vx7\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012552 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-lib-modules\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.012552 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.012338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58446c96-e1c9-4469-ac22-f6136696198e-proc\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.022439 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.022396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vx7\" (UniqueName: \"kubernetes.io/projected/58446c96-e1c9-4469-ac22-f6136696198e-kube-api-access-j5vx7\") pod \"perf-node-gather-daemonset-f88tn\" (UID: \"58446c96-e1c9-4469-ac22-f6136696198e\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.173344 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.173248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:22.365320 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:22.365223    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"]
Jul 13 22:07:22.371395 ip-10-0-136-49 kubenswrapper[2565]: W0713 22:07:22.371361    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58446c96_e1c9_4469_ac22_f6136696198e.slice/crio-c4f004099babe4e9327b74ee3aef1a2cd4bf8d578c49146dd827ef330b47bb2f WatchSource:0}: Error finding container c4f004099babe4e9327b74ee3aef1a2cd4bf8d578c49146dd827ef330b47bb2f: Status 404 returned error can't find the container with id c4f004099babe4e9327b74ee3aef1a2cd4bf8d578c49146dd827ef330b47bb2f
Jul 13 22:07:23.153679 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:23.153637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn" event={"ID":"58446c96-e1c9-4469-ac22-f6136696198e","Type":"ContainerStarted","Data":"a465caa924168fc9c477f4bdd47f53402fc2fc2a6ee3851e444ef35869bb81af"}
Jul 13 22:07:23.153942 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:23.153699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn" event={"ID":"58446c96-e1c9-4469-ac22-f6136696198e","Type":"ContainerStarted","Data":"c4f004099babe4e9327b74ee3aef1a2cd4bf8d578c49146dd827ef330b47bb2f"}
Jul 13 22:07:23.153942 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:23.153766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:23.170562 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:23.170496    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn" podStartSLOduration=2.170472471 podStartE2EDuration="2.170472471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:07:23.169098802 +0000 UTC m=+2712.594047845" watchObservedRunningTime="2026-07-13 22:07:23.170472471 +0000 UTC m=+2712.595421512"
Jul 13 22:07:25.114210 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:25.114180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvr2b_bed13a5b-934b-4a52-bafe-49050de274cc/dns/0.log"
Jul 13 22:07:25.135547 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:25.135514    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvr2b_bed13a5b-934b-4a52-bafe-49050de274cc/kube-rbac-proxy/0.log"
Jul 13 22:07:25.206442 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:25.206400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gvp4g_67bc7979-d12b-43db-87d5-c52b0936c85f/dns-node-resolver/0.log"
Jul 13 22:07:25.808713 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:25.808674    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5df8554cf9-2d9s6_9d0d54f9-7baa-426d-9897-3e48d363996e/registry/0.log"
Jul 13 22:07:25.832504 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:25.832466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mclf9_740767ae-217d-4f15-b44f-86a3a32756c7/node-ca/0.log"
Jul 13 22:07:27.058015 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:27.057984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6964b4f475-jbbw4_da8125f7-82f3-4401-81e0-8dfa282263c9/kube-auth-proxy/0.log"
Jul 13 22:07:28.017883 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:28.017847    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p5v8q_45be4650-4057-4814-970b-7519a07c7e5a/serve-healthcheck-canary/0.log"
Jul 13 22:07:28.494372 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:28.494346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jtjk_efbd6fe2-1f27-4373-9b76-e24eda507db6/kube-rbac-proxy/0.log"
Jul 13 22:07:28.515839 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:28.515809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jtjk_efbd6fe2-1f27-4373-9b76-e24eda507db6/exporter/0.log"
Jul 13 22:07:28.537748 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:28.537718    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jtjk_efbd6fe2-1f27-4373-9b76-e24eda507db6/extractor/0.log"
Jul 13 22:07:29.172957 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:29.172929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-f88tn"
Jul 13 22:07:31.623972 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:31.623926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-hn4qq_400afb64-3517-43ab-baff-efd22155a74f/manager/0.log"
Jul 13 22:07:31.651598 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:31.651565    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-hn4qq_400afb64-3517-43ab-baff-efd22155a74f/copy-manifests/0.log"
Jul 13 22:07:33.192901 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:33.192868    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74864c9df6-njwq6_9a08b92a-c5b3-4bb8-8d47-96404ab5c879/manager/0.log"
Jul 13 22:07:33.261265 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:33.261232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-x54f4_c2b9b0b1-4f18-44c5-950a-0ccc19e8c78c/openshift-lws-operator/0.log"
Jul 13 22:07:33.298592 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:33.298490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6964b4f475-jbbw4_da8125f7-82f3-4401-81e0-8dfa282263c9/kube-auth-proxy/0.log"
Jul 13 22:07:34.968569 ip-10-0-136-49 kubenswrapper[2565]: I0713 22:07:34.968534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6964b4f475-jbbw4_da8125f7-82f3-4401-81e0-8dfa282263c9/kube-auth-proxy/0.log"