Jul 07 19:59:04.047844 ip-10-0-134-113 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 19:59:04.047853 ip-10-0-134-113 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 19:59:04.047860 ip-10-0-134-113 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 19:59:04.048097 ip-10-0-134-113 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 19:59:14.116120 ip-10-0-134-113 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 19:59:14.116136 ip-10-0-134-113 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f9532b80f3b84fb79b804e42c5df0a9a --
Jul 07 20:01:07.724218 ip-10-0-134-113 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 20:01:08.046693 ip-10-0-134-113 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 20:01:08.046693 ip-10-0-134-113 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 20:01:08.046693 ip-10-0-134-113 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 20:01:08.046693 ip-10-0-134-113 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 20:01:08.046693 ip-10-0-134-113 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 20:01:08.047464 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.047376    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053209    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053229    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053233    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053237    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053241    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.053238 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053245    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053248    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053251    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053254    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053257    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053260    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053262    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053266    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053269    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053271    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053274    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053277    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053279    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053282    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053284    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053287    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053289    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053292    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053294    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053297    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.053460 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053299    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053302    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053305    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053309    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053311    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053315    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053319    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053322    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053325    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053328    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053331    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053334    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053337    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053340    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053344    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053347    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053350    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053353    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053356    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053358    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.053955 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053361    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053364    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053366    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053369    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053371    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053374    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053377    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053380    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053383    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053385    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053388    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053392    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053396    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053398    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053401    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053404    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053406    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053409    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053411    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.054462 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053414    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053416    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053419    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053422    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053424    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053427    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053429    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053432    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053435    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053438    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053441    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053444    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053446    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053449    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053452    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053454    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053457    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053459    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053462    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053466    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.054941 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053468    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053471    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053474    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053477    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053479    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053482    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053484    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053487    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053490    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053493    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053495    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053498    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053502    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053506    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.053509    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054227    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054235    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054237    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054240    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054244    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.055410 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054247    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054249    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054252    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054254    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054257    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054259    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054262    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054265    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054267    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054270    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054272    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054275    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054279    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054281    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054285    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054289    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054291    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054294    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054297    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054299    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.055870 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054302    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054304    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054307    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054309    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054311    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054314    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054316    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054319    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054322    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054325    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054327    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054331    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054333    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054336    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054338    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054341    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054343    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054346    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054349    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054351    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.056417 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054353    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054356    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054359    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054361    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054364    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054367    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054369    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054372    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054374    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054377    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054379    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054382    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054384    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054386    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054389    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054392    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054394    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054397    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054399    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054402    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.056966 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054405    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054408    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054410    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054414    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054416    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054421    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054424    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054428    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054430    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054433    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054436    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054439    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054442    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054444    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054447    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054449    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054452    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054454    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054458    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.057447 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054462    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054464    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054467    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054470    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054473    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054476    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054478    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054481    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054485    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054488    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054491    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054494    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054497    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054500    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054503    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054888    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054910    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054913    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054916    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.057924 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054919    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054922    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054925    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054927    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054930    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054932    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054935    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054938    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054940    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054943    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054946    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054948    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054952    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054955    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054959    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054962    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054965    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054968    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054971    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054973    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.058387 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054976    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054978    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054981    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054984    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054986    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054988    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054991    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054993    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054996    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.054999    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055001    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055004    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055006    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055009    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055012    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055015    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055017    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055020    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055022    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.058883 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055024    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055027    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055029    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055032    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055034    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055037    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055040    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055042    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055045    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055047    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055049    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055052    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055054    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055059    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055062    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055065    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055068    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055071    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055073    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.059359 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055076    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055078    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055081    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055084    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055086    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055089    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055091    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055094    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055096    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055099    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055102    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055104    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055106    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055109    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055111    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055115    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055117    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055119    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055122    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055124    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.059826 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055127    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055129    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055132    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055134    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055137    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055139    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055142    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055148    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055151    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055154    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055157    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055160    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055162    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055165    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055168    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055171    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055173    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055240    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055251    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055257    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 20:01:08.060319 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055262    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055266    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055269    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055273    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055277    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055280    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055283    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055287    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055290    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055293    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055296    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055299    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055301    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055307    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055311    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055315    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055320    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055323    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055326    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055330    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055333    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055336    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055339    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 20:01:08.060795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055342    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055345    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055348    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055351    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055355    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055358    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055362    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055365    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055368    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055371    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055374    2562 flags.go:64] FLAG: --enable-server="true"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055377    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055382    2562 flags.go:64] FLAG: --event-burst="100"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055385    2562 flags.go:64] FLAG: --event-qps="50"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055387    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055390    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055393    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055397    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055400    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055402    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055405    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055409    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055412    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055415    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055418    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 20:01:08.061373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055423    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055426    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055429    2562 flags.go:64] FLAG: --feature-gates=""
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055432    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055435    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055438    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055442    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055445    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055448    2562 flags.go:64] FLAG: --help="false"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055451    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-113.ec2.internal"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055454    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055458    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055461    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055464    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055468    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055471    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055474    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055476    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055479    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055481    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055485    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055487    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055490    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055493    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 20:01:08.062047 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055496    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055498    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055501    2562 flags.go:64] FLAG: --lock-file=""
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055504    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055507    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055510    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055515    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055519    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055523    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055526    2562 flags.go:64] FLAG: --logging-format="text"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055528    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055531    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055534    2562 flags.go:64] FLAG: --manifest-url=""
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055537    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055541    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055544    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055548    2562 flags.go:64] FLAG: --max-pods="110"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055551    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055554    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055559    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055561    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055564    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055567    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055570    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055577    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 20:01:08.062630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055580    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055583    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055586    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055589    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055594    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055597    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055600    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055602    2562 flags.go:64] FLAG: --port="10250"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055605    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055608    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d07a6faf2238c4f"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055611    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055614    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055617    2562 flags.go:64] FLAG: --register-node="true"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055619    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055623    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055626    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055631    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055634    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055637    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055640    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055643    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055646    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055649    2562 flags.go:64] FLAG: --runonce="false"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055652    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055655    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 20:01:08.063250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055658    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055662    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055665    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055668    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055671    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055674    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055676    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055679    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055682    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055685    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055688    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055690    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055693    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055698    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055700    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055703    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055707    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055710    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055713    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055715    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055718    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055721    2562 flags.go:64] FLAG: --v="2"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055725    2562 flags.go:64] FLAG: --version="false"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055731    2562 flags.go:64] FLAG: --vmodule=""
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055735    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 20:01:08.063852 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.055738    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055859    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055863    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055867    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055871    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055875    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055878    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055881    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055885    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055890    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055908    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055913    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055916    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055919    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055922    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055925    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055928    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055931    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.064490 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055934    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055937    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055939    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055942    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055945    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055947    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055950    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055952    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055955    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055959    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055963    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055967    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055970    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055973    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055976    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055978    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055981    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055984    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055986    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.064990 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055990    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055993    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.055997    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056000    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056003    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056005    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056008    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056010    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056013    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056015    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056018    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056020    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056023    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056025    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056028    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056031    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056033    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056035    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056038    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.065459 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056040    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056043    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056045    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056047    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056050    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056054    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056057    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056060    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056063    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056065    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056068    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056070    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056073    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056076    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056078    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056082    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056084    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056087    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056089    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056092    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.065989 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056097    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056100    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056102    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056105    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056107    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056110    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056112    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056115    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056117    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056119    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056122    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056124    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056127    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056129    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056131    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056134    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056138    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056140    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056142    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.066472 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056145    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056148    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.056150    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.056810    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.063737    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.063754    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.064347    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.064355    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064435    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064440    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064444    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064447    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064450    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064453    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064456    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.066979 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064459    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064464    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064467    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064470    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064473    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064476    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064479    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064482    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064485    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064488    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064491    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064495    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064498    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064502    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064505    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064508    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064511    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064520    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.067376 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064523    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064526    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064529    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064531    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064534    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064537    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064539    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064542    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064545    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064548    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064553    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064555    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064558    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064561    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064563    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064566    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064568    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064571    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064573    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064576    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.067831 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064578    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064581    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064584    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064586    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064589    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064592    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064594    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064597    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064599    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064602    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064604    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064607    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064615    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064617    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064620    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064622    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064625    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064628    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064631    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064633    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064636    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.068347 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064639    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064641    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064644    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064647    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064649    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064652    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064654    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064657    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064659    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064662    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064664    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064666    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064670    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064672    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064675    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064677    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064680    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064683    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064685    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064688    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.068876 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064690    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064693    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064695    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064697    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064706    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064709    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064711    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064714    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064717    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064719    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064722    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064724    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064727    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.064732    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064919    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 20:01:08.069422 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064925    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064928    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064931    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064935    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064939    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064942    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064945    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064948    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064951    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064954    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064957    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064960    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064962    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064965    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064968    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064970    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064973    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064975    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064978    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064980    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 20:01:08.069806 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064982    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064985    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064993    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064997    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.064999    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065002    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065005    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065008    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065010    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065013    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065015    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065018    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065020    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065023    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065025    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065028    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065030    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065032    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065035    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 20:01:08.070317 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065037    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065040    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065043    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065046    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065048    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065051    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065053    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065056    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065058    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065061    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065064    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065067    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065071    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065074    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065076    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065079    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065088    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065091    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065100    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 20:01:08.070791 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065104    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065106    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065109    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065111    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065114    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065116    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065119    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065122    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065124    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065127    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065129    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065132    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065134    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065137    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065139    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065142    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065145    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065147    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065150    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065152    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 20:01:08.071289 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065155    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065158    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065160    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065163    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065165    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065168    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065171    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065174    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065177    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065179    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065188    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065191    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065194    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065196    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065199    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065201    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065204    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065206    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065209    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 20:01:08.071822 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:08.065211    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.065216    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.065329    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.067398    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.068641    2562 server.go:1019] "Starting client certificate rotation"
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.068742    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.068780    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 20:01:08.072289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.070931    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 20:01:08.074254 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.074228    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 20:01:08.083500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.083479    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 07 20:01:08.086768 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.086753    2562 log.go:25] "Validated CRI v1 image API"
Jul 07 20:01:08.087505 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.087488    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 20:01:08.089563 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.089543    2562 fs.go:135] Filesystem UUIDs: map[18f7d8a9-ce70-4068-af21-2021ca53332e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a8a8a57c-fc6d-4544-aba2-d03a3ddd9349:/dev/nvme0n1p3]
Jul 07 20:01:08.089625 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.089561    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 20:01:08.094798 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.094689    2562 manager.go:216] Machine: {Timestamp:2026-07-07 20:01:08.093521212 +0000 UTC m=+0.268710528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096204 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f8eb51b20021a17749a42f26f29c5 SystemUUID:ec2f8eb5-1b20-021a-1774-9a42f26f29c5 BootID:f9532b80-f3b8-4fb7-9b80-4e42c5df0a9a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:a7:83:27:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:a7:83:27:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:0b:d3:e0:40:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 20:01:08.094798 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.094793    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 20:01:08.094928 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.094878    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 20:01:08.097623 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.097591    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 20:01:08.097771 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.097627    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 20:01:08.098291 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.098279    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 20:01:08.098328 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.098293    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 20:01:08.098328 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.098301    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 20:01:08.098837 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.098827    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 20:01:08.099062 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.099046    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 20:01:08.100131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.100120    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 20:01:08.104096 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104083    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 20:01:08.104275 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104265    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 20:01:08.104307 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104297    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 20:01:08.104307 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104307    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 20:01:08.104358 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104326    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 20:01:08.104358 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104336    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 07 20:01:08.104358 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104345    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 20:01:08.104755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104742    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 20:01:08.104796 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.104762    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 20:01:08.106759 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.106738    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 20:01:08.108577 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.108563    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 20:01:08.108623 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.108594    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 20:01:08.109704 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109692    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109710    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109717    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109723    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109731    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109737    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109745    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 20:01:08.109755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109750    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 20:01:08.109973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109765    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 20:01:08.109973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109772    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 20:01:08.109973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109785    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 20:01:08.109973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.109791    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 20:01:08.111042 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.111030    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 20:01:08.111095 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.111055    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 20:01:08.114335 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.114321    2562 server.go:1268] "Started kubelet"
Jul 07 20:01:08.114497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.114454    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 20:01:08.117501 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.114504    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 20:01:08.117668 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.117644    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 20:01:08.118803 ip-10-0-134-113 systemd[1]: Started Kubernetes Kubelet.
Jul 07 20:01:08.119494 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.119317    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 20:01:08.120608 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.120589    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 20:01:08.120957 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.120923    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 20:01:08.121181 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.121160    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 20:01:08.121572 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.121509    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 20:01:08.121866 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.121846    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 20:01:08.123985 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.123034    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-113.ec2.internal.18c01a63bd091d99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-113.ec2.internal,UID:ip-10-0-134-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-113.ec2.internal,},FirstTimestamp:2026-07-07 20:01:08.114292121 +0000 UTC m=+0.289481433,LastTimestamp:2026-07-07 20:01:08.114292121 +0000 UTC m=+0.289481433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-113.ec2.internal,}"
Jul 07 20:01:08.127002 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.126983    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 20:01:08.127002 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.126992    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 20:01:08.127166 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.127145    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:08.127681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127666    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 20:01:08.127765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127666    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 20:01:08.127765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127718    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 20:01:08.127863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127796    2562 factory.go:55] Registering systemd factory
Jul 07 20:01:08.127863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127811    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 07 20:01:08.127863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127832    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 20:01:08.127863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.127841    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 20:01:08.128044 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128021    2562 factory.go:153] Registering CRI-O factory
Jul 07 20:01:08.128044 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128035    2562 factory.go:223] Registration of the crio container factory successfully
Jul 07 20:01:08.128142 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128087    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 20:01:08.128142 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128121    2562 factory.go:103] Registering Raw factory
Jul 07 20:01:08.128142 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128137    2562 manager.go:1196] Started watching for new ooms in manager
Jul 07 20:01:08.128603 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.128590    2562 manager.go:349] Starting recovery of all containers
Jul 07 20:01:08.133056 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.133032    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 20:01:08.133176 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.133152    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 20:01:08.137174 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.137149    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fdkhk"
Jul 07 20:01:08.137778 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.137762    2562 manager.go:354] Recovery completed
Jul 07 20:01:08.143274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.143254    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:08.145292 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145273    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:08.145343 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145315    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:08.145343 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145332    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:08.145701 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145683    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fdkhk"
Jul 07 20:01:08.145980 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145958    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 20:01:08.145980 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145977    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 20:01:08.146082 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145995    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 20:01:08.146082 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.145967    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:08.146888 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.146768    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:08.146973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.146925    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:08.146973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.146944    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:08.147660 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.147590    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-113.ec2.internal.18c01a63bee22e4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-113.ec2.internal,UID:ip-10-0-134-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-113.ec2.internal,},FirstTimestamp:2026-07-07 20:01:08.145294924 +0000 UTC m=+0.320484246,LastTimestamp:2026-07-07 20:01:08.145294924 +0000 UTC m=+0.320484246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-113.ec2.internal,}"
Jul 07 20:01:08.148821 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.148807    2562 policy_none.go:49] "None policy: Start"
Jul 07 20:01:08.148869 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.148825    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 20:01:08.148869 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.148844    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 20:01:08.150857 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.150846    2562 policy_none.go:47] "Start"
Jul 07 20:01:08.184507 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.184490    2562 manager.go:337] "Starting Device Plugin manager"
Jul 07 20:01:08.184587 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.184530    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 20:01:08.184587 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.184543    2562 server.go:87] "Starting device plugin registration server"
Jul 07 20:01:08.184823 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.184812    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 20:01:08.184879 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.184824    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 20:01:08.184961 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.184944    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 20:01:08.185064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.185047    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 20:01:08.185064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.185062    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 20:01:08.185604 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.185585    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 20:01:08.185683 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.185630    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:08.243598 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.243559    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 20:01:08.245818 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.244681    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 20:01:08.245818 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.244722    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 20:01:08.245818 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.244745    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 20:01:08.245818 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.244783    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 20:01:08.247352 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.247328    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 20:01:08.285548 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.285514    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:08.286527 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.286507    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:08.286619 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.286540    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:08.286619 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.286551    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:08.286619 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.286577    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-113.ec2.internal"
Jul 07 20:01:08.295037 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:08.295015    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-113.ec2.internal"
Jul 07 20:01:08.295143 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.295048    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-113.ec2.internal\": node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:08.319683 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:08.319599    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:09.680632 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.680312    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"]
Jul 07 20:01:09.680632 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.680375    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:09.681298 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.681280    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:09.681361 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.681311    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:09.681361 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.681321    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:09.683732 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.683720    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:09.683839 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.683824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.683875 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.683857    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:09.684429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684413    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:09.684429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684424    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:09.684582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684440    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:09.684582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684446    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:09.684582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684455    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:09.684582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.684459    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:09.686891 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.686878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.686962 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.686903    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 20:01:09.687637 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.687621    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 20:01:09.687722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.687651    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 20:01:09.687722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.687666    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeHasSufficientPID"
Jul 07 20:01:09.704278 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:09.704251    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-113.ec2.internal\" not found" node="ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.708915 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:09.708896    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-113.ec2.internal\" not found" node="ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.754671 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:09.754643    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:09.763743 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.763710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.763854 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.763746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.763854 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.763764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66d40220305fe03479bbe46175f2cd79-config\") pod \"kube-apiserver-proxy-ip-10-0-134-113.ec2.internal\" (UID: \"66d40220305fe03479bbe46175f2cd79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.854966 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:09.854928    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:09.864309 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.864384 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66d40220305fe03479bbe46175f2cd79-config\") pod \"kube-apiserver-proxy-ip-10-0-134-113.ec2.internal\" (UID: \"66d40220305fe03479bbe46175f2cd79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.864384 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.864384 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.864483 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eab86221f4cc923c73e223abc50211e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal\" (UID: \"6eab86221f4cc923c73e223abc50211e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.864483 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:09.864412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66d40220305fe03479bbe46175f2cd79-config\") pod \"kube-apiserver-proxy-ip-10-0-134-113.ec2.internal\" (UID: \"66d40220305fe03479bbe46175f2cd79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:09.955868 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:09.955780    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.007319 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.007288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:10.012979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.012214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:10.056260 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.056226    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.156816 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.156764    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.257386 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.257283    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.357880 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.357855    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.403434 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.403408    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 20:01:10.403933 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.403556    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 20:01:10.458515 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.458485    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.475949 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.475928    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 20:01:10.483028 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.482997    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 19:56:09 +0000 UTC" deadline="2028-02-11 16:15:00.92952864 +0000 UTC"
Jul 07 20:01:10.483070 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.483030    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14012h13m50.446503489s"
Jul 07 20:01:10.559387 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.559328    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.659461 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.659429    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.699123 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:10.699092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d40220305fe03479bbe46175f2cd79.slice/crio-de272b82b5717951bd1327013b9d190c0b988416a01c740e718959e5f9316753 WatchSource:0}: Error finding container de272b82b5717951bd1327013b9d190c0b988416a01c740e718959e5f9316753: Status 404 returned error can't find the container with id de272b82b5717951bd1327013b9d190c0b988416a01c740e718959e5f9316753
Jul 07 20:01:10.703619 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.703603    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 20:01:10.760061 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.760020    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.860691 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.860602    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.961424 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:10.961388    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-113.ec2.internal\" not found"
Jul 07 20:01:10.963211 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:10.963190    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 20:01:11.026990 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.026966    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 20:01:11.062087 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.062053    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:11.077741 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.077719    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 20:01:11.078610 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.078583    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal"
Jul 07 20:01:11.089420 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.089401    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 20:01:11.440044 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.440019    2562 apiserver.go:52] "Watching apiserver"
Jul 07 20:01:11.448488 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.448463    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 20:01:11.450147 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.450126    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-mclb4","openshift-multus/network-metrics-daemon-6kfsv","openshift-network-operator/iptables-alerter-8r7wd","openshift-ovn-kubernetes/ovnkube-node-fmdjn","kube-system/konnectivity-agent-lhg64","kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw","openshift-dns/node-resolver-cpgxw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal","openshift-multus/multus-additional-cni-plugins-gvmg4","openshift-multus/multus-m7vlt","openshift-network-diagnostics/network-check-target-5ggpz","kube-system/global-pull-secret-syncer-ss8j7","openshift-cluster-node-tuning-operator/tuned-7b2cd"]
Jul 07 20:01:11.452612 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.452577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.454693 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.454676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.454771 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.454732    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:11.455264 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.455252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 20:01:11.455678 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.455665    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.455728 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.455716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-blhsp\""
Jul 07 20:01:11.455872 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.455857    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.456882 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.456861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.459064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.459046    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 20:01:11.459148 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.459052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4gdht\""
Jul 07 20:01:11.459315 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.459294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.459416 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.459344    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.459416 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.459400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.461494 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.461652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6v9cd\""
Jul 07 20:01:11.461810 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461794    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 20:01:11.461873 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461844    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 20:01:11.461960 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461916    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 20:01:11.461960 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.461953    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.462549 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.462522    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 20:01:11.463023 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.463006    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.463113 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.463034    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 20:01:11.463847 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.463829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hl2ps\""
Jul 07 20:01:11.463919 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.463873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.465121 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.465106    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 20:01:11.465599 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.465570    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 20:01:11.466059 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.466044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.466554 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.466536    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.466554 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.466548    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rlrgc\""
Jul 07 20:01:11.466785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.466773    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.468780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.468415    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.468780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.468443    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.468780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.468466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7fqh6\""
Jul 07 20:01:11.468780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.468474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.470722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.470704    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 20:01:11.470800 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.470737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.470849 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.470793    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:11.470954 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.470932    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.471218 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.471202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.471297 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.471283    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2tgj9\""
Jul 07 20:01:11.473160 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.473146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/194dcf45-e49c-40c5-954a-aeb1f7c29a45-agent-certs\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-tuned\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-var-lib-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09042a1f-f767-4f55-bcab-76147adceb5e-host-slash\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-systemd-units\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-slash\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-env-overrides\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.474964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8254250f-135c-4816-8cb2-ee28028097f4-ovn-node-metrics-cert\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b88\" (UniqueName: \"kubernetes.io/projected/8254250f-135c-4816-8cb2-ee28028097f4-kube-api-access-74b88\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-modprobe-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-config\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-kubernetes\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-conf\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-systemd\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-lib-modules\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-var-lib-kubelet\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-device-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-netns\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-sys\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-kubelet\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.475573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-systemd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-node-log\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-run\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6dc\" (UniqueName: \"kubernetes.io/projected/d84c0b72-fe1e-4aa1-9b7f-aed514282415-kube-api-access-8k6dc\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqghn\" (UniqueName: \"kubernetes.io/projected/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kube-api-access-kqghn\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-dbus\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.475984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-bin\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-kubelet-config\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09042a1f-f767-4f55-bcab-76147adceb5e-iptables-alerter-script\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-etc-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7lct\""
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-script-lib\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/194dcf45-e49c-40c5-954a-aeb1f7c29a45-konnectivity-ca\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysconfig\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-host\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476414    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.476419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-tmp\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2hp2\" (UniqueName: \"kubernetes.io/projected/09042a1f-f767-4f55-bcab-76147adceb5e-kube-api-access-c2hp2\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-log-socket\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477745    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.477836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.477999    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.478020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-ovn\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.478046    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 20:01:11.478197 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.478077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-netd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.479722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.479705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:11.479804 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.479759    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:11.481250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.481230    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-prgz7\""
Jul 07 20:01:11.481335 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.481278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 20:01:11.506032 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.506011    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2lww"
Jul 07 20:01:11.516331 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.516312    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2lww"
Jul 07 20:01:11.563323 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.563297    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 20:01:11.578861 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.578829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqghn\" (UniqueName: \"kubernetes.io/projected/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kube-api-access-kqghn\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.579025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.578871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c57dccef-fbed-4ee2-9852-9760f1285278-hosts-file\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.579025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.578934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-var-lib-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.578955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-slash\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.578982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8254250f-135c-4816-8cb2-ee28028097f4-ovn-node-metrics-cert\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-modprobe-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-var-lib-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-kubernetes\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-systemd\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-systemd\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-kubernetes\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-slash\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-modprobe-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-config\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-device-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cnibin\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-device-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xnp\" (UniqueName: \"kubernetes.io/projected/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-kube-api-access-g4xnp\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-cnibin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-conf-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579345    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdn6p\" (UniqueName: \"kubernetes.io/projected/0d06f8fd-5135-4622-ac72-214644d5e7b1-kube-api-access-xdn6p\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-system-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-k8s-cni-cncf-io\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvkb\" (UniqueName: \"kubernetes.io/projected/09129cef-94af-4411-a135-34a093fb642d-kube-api-access-gkvkb\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-kubelet\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-node-log\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-kubelet\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.579826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-socket-dir-parent\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-bin\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-node-log\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-kubelet-config\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579726    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-bin\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-hostroot\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-multus-daemon-config\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579773    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-kubelet-config\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-dbus\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09042a1f-f767-4f55-bcab-76147adceb5e-iptables-alerter-script\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-etc-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/194dcf45-e49c-40c5-954a-aeb1f7c29a45-konnectivity-ca\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysconfig\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-dbus\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-host\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-tmp\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.580640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysconfig\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580000    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.579936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-etc-openvswitch\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580070    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-host\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-d\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580337    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-config\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09042a1f-f767-4f55-bcab-76147adceb5e-iptables-alerter-script\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.580388    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:11.581377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-os-release\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.580470    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:12.08042919 +0000 UTC m=+2.920926049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-cni-binary-copy\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-ovn\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-netd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/194dcf45-e49c-40c5-954a-aeb1f7c29a45-agent-certs\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-ovn\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-kubelet\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-cni-netd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09042a1f-f767-4f55-bcab-76147adceb5e-host-slash\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-systemd-units\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-env-overrides\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74b88\" (UniqueName: \"kubernetes.io/projected/8254250f-135c-4816-8cb2-ee28028097f4-kube-api-access-74b88\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0a027f-d75f-4621-ba21-8ea1506ffab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.582150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-lib-modules\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-systemd-units\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36955712-fb96-436a-b7ab-bc4bb2858822-host\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09042a1f-f767-4f55-bcab-76147adceb5e-host-slash\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-lib-modules\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.580995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-etc-kubernetes\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/194dcf45-e49c-40c5-954a-aeb1f7c29a45-konnectivity-ca\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-conf\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-var-lib-kubelet\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36955712-fb96-436a-b7ab-bc4bb2858822-serviceca\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-multus-certs\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581161    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-env-overrides\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-netns\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581180    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-sysctl-conf\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-var-lib-kubelet\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581224    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-netns\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-sys\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.582922 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581242    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-sys\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-systemd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-run\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581329    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-run-systemd\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6dc\" (UniqueName: \"kubernetes.io/projected/d84c0b72-fe1e-4aa1-9b7f-aed514282415-kube-api-access-8k6dc\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d84c0b72-fe1e-4aa1-9b7f-aed514282415-run\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-os-release\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-multus\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-script-lib\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq48s\" (UniqueName: \"kubernetes.io/projected/c57dccef-fbed-4ee2-9852-9760f1285278-kube-api-access-zq48s\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-bin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2hp2\" (UniqueName: \"kubernetes.io/projected/09042a1f-f767-4f55-bcab-76147adceb5e-kube-api-access-c2hp2\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-log-socket\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57dccef-fbed-4ee2-9852-9760f1285278-tmp-dir\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.583792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581722    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8254250f-135c-4816-8cb2-ee28028097f4-log-socket\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-tuned\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2cm\" (UniqueName: \"kubernetes.io/projected/36955712-fb96-436a-b7ab-bc4bb2858822-kube-api-access-7w2cm\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.581976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-system-cni-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.582012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-netns\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.582013    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8254250f-135c-4816-8cb2-ee28028097f4-ovnkube-script-lib\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.584389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-tmp\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.584523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.584479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8254250f-135c-4816-8cb2-ee28028097f4-ovn-node-metrics-cert\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.585026 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.584607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/194dcf45-e49c-40c5-954a-aeb1f7c29a45-agent-certs\") pod \"konnectivity-agent-lhg64\" (UID: \"194dcf45-e49c-40c5-954a-aeb1f7c29a45\") " pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.585026 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.585002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d84c0b72-fe1e-4aa1-9b7f-aed514282415-etc-tuned\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.586285 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.586229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal" event={"ID":"66d40220305fe03479bbe46175f2cd79","Type":"ContainerStarted","Data":"de272b82b5717951bd1327013b9d190c0b988416a01c740e718959e5f9316753"}
Jul 07 20:01:11.588223 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.588191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqghn\" (UniqueName: \"kubernetes.io/projected/2a0a027f-d75f-4621-ba21-8ea1506ffab1-kube-api-access-kqghn\") pod \"aws-ebs-csi-driver-node-qr4gw\" (UID: \"2a0a027f-d75f-4621-ba21-8ea1506ffab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.589946 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.589925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b88\" (UniqueName: \"kubernetes.io/projected/8254250f-135c-4816-8cb2-ee28028097f4-kube-api-access-74b88\") pod \"ovnkube-node-fmdjn\" (UID: \"8254250f-135c-4816-8cb2-ee28028097f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.593193 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.593147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2hp2\" (UniqueName: \"kubernetes.io/projected/09042a1f-f767-4f55-bcab-76147adceb5e-kube-api-access-c2hp2\") pod \"iptables-alerter-8r7wd\" (UID: \"09042a1f-f767-4f55-bcab-76147adceb5e\") " pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.593279 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.593199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6dc\" (UniqueName: \"kubernetes.io/projected/d84c0b72-fe1e-4aa1-9b7f-aed514282415-kube-api-access-8k6dc\") pod \"tuned-7b2cd\" (UID: \"d84c0b72-fe1e-4aa1-9b7f-aed514282415\") " pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.657935 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.657904    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 20:01:11.683056 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq48s\" (UniqueName: \"kubernetes.io/projected/c57dccef-fbed-4ee2-9852-9760f1285278-kube-api-access-zq48s\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.683056 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-bin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57dccef-fbed-4ee2-9852-9760f1285278-tmp-dir\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683149    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-bin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2cm\" (UniqueName: \"kubernetes.io/projected/36955712-fb96-436a-b7ab-bc4bb2858822-kube-api-access-7w2cm\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-system-cni-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-netns\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.683273    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:11.683305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c57dccef-fbed-4ee2-9852-9760f1285278-hosts-file\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-system-cni-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.683353    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:12.18333166 +0000 UTC m=+3.023828537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cnibin\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cnibin\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c57dccef-fbed-4ee2-9852-9760f1285278-hosts-file\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xnp\" (UniqueName: \"kubernetes.io/projected/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-kube-api-access-g4xnp\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-netns\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-cnibin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-conf-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdn6p\" (UniqueName: \"kubernetes.io/projected/0d06f8fd-5135-4622-ac72-214644d5e7b1-kube-api-access-xdn6p\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-cnibin\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57dccef-fbed-4ee2-9852-9760f1285278-tmp-dir\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-system-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-conf-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-k8s-cni-cncf-io\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.683805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683624    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-system-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-k8s-cni-cncf-io\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvkb\" (UniqueName: \"kubernetes.io/projected/09129cef-94af-4411-a135-34a093fb642d-kube-api-access-gkvkb\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-socket-dir-parent\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-hostroot\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-multus-daemon-config\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683819    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-socket-dir-parent\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-os-release\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683823    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-hostroot\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-cni-binary-copy\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-os-release\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-kubelet\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36955712-fb96-436a-b7ab-bc4bb2858822-host\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683916    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-kubelet\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.684479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-etc-kubernetes\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36955712-fb96-436a-b7ab-bc4bb2858822-serviceca\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.683964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36955712-fb96-436a-b7ab-bc4bb2858822-host\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-multus-certs\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-multus-cni-dir\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684053    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-etc-kubernetes\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-os-release\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684095    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-run-multus-certs\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-multus\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-os-release\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09129cef-94af-4411-a135-34a093fb642d-host-var-lib-cni-multus\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-multus-daemon-config\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09129cef-94af-4411-a135-34a093fb642d-cni-binary-copy\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36955712-fb96-436a-b7ab-bc4bb2858822-serviceca\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.685277 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.684560    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.691508 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.691444    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:11.691508 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.691470    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:11.691508 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.691484    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:11.691723 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:11.691563    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:12.191545162 +0000 UTC m=+3.032042020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:11.694212 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.694163    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq48s\" (UniqueName: \"kubernetes.io/projected/c57dccef-fbed-4ee2-9852-9760f1285278-kube-api-access-zq48s\") pod \"node-resolver-cpgxw\" (UID: \"c57dccef-fbed-4ee2-9852-9760f1285278\") " pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.694889 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.694838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2cm\" (UniqueName: \"kubernetes.io/projected/36955712-fb96-436a-b7ab-bc4bb2858822-kube-api-access-7w2cm\") pod \"node-ca-mclb4\" (UID: \"36955712-fb96-436a-b7ab-bc4bb2858822\") " pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.695201 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.695178    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xnp\" (UniqueName: \"kubernetes.io/projected/9f91be0c-74f0-4df9-9b90-e8c82fad3f72-kube-api-access-g4xnp\") pod \"multus-additional-cni-plugins-gvmg4\" (UID: \"9f91be0c-74f0-4df9-9b90-e8c82fad3f72\") " pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.695529 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.695492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvkb\" (UniqueName: \"kubernetes.io/projected/09129cef-94af-4411-a135-34a093fb642d-kube-api-access-gkvkb\") pod \"multus-m7vlt\" (UID: \"09129cef-94af-4411-a135-34a093fb642d\") " pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:11.695842 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.695815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdn6p\" (UniqueName: \"kubernetes.io/projected/0d06f8fd-5135-4622-ac72-214644d5e7b1-kube-api-access-xdn6p\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:11.762106 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.762075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw"
Jul 07 20:01:11.770229 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.770204    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r7wd"
Jul 07 20:01:11.772309 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:11.772283    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0a027f_d75f_4621_ba21_8ea1506ffab1.slice/crio-42a7db26d07fbbf20208654edbcd4b279391ffc42864862db7c86fbba888d236 WatchSource:0}: Error finding container 42a7db26d07fbbf20208654edbcd4b279391ffc42864862db7c86fbba888d236: Status 404 returned error can't find the container with id 42a7db26d07fbbf20208654edbcd4b279391ffc42864862db7c86fbba888d236
Jul 07 20:01:11.778294 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.778275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:11.780895 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:11.780865    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09042a1f_f767_4f55_bcab_76147adceb5e.slice/crio-486e494aa23dad6b398129f23a42be1cc96524de0a123e9de08b6d396e1cccad WatchSource:0}: Error finding container 486e494aa23dad6b398129f23a42be1cc96524de0a123e9de08b6d396e1cccad: Status 404 returned error can't find the container with id 486e494aa23dad6b398129f23a42be1cc96524de0a123e9de08b6d396e1cccad
Jul 07 20:01:11.783920 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.783904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:11.788756 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.788738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7b2cd"
Jul 07 20:01:11.794287 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.794268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpgxw"
Jul 07 20:01:11.799977 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.799956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mclb4"
Jul 07 20:01:11.805626 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.805607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvmg4"
Jul 07 20:01:11.810190 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:11.810175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7vlt"
Jul 07 20:01:12.087289 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.087202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:12.087456 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.087335    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:12.087456 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.087396    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:13.087381652 +0000 UTC m=+3.927878507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:12.126707 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.126651    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8254250f_135c_4816_8cb2_ee28028097f4.slice/crio-e672752dda70a9e7493a2f1af582cbb5be53a90c1a89e77251f87762041afe37 WatchSource:0}: Error finding container e672752dda70a9e7493a2f1af582cbb5be53a90c1a89e77251f87762041afe37: Status 404 returned error can't find the container with id e672752dda70a9e7493a2f1af582cbb5be53a90c1a89e77251f87762041afe37
Jul 07 20:01:12.133427 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.133400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194dcf45_e49c_40c5_954a_aeb1f7c29a45.slice/crio-fddbd89735e6579ed72691477bea69cc06809b2de8b530d091e00beab3055e7c WatchSource:0}: Error finding container fddbd89735e6579ed72691477bea69cc06809b2de8b530d091e00beab3055e7c: Status 404 returned error can't find the container with id fddbd89735e6579ed72691477bea69cc06809b2de8b530d091e00beab3055e7c
Jul 07 20:01:12.134278 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.134205    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84c0b72_fe1e_4aa1_9b7f_aed514282415.slice/crio-3fa053de13c7e7ecdc9c5b0256e336292c21f18bf16f9bd8a67d63ad1ffb802a WatchSource:0}: Error finding container 3fa053de13c7e7ecdc9c5b0256e336292c21f18bf16f9bd8a67d63ad1ffb802a: Status 404 returned error can't find the container with id 3fa053de13c7e7ecdc9c5b0256e336292c21f18bf16f9bd8a67d63ad1ffb802a
Jul 07 20:01:12.136891 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.136774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57dccef_fbed_4ee2_9852_9760f1285278.slice/crio-a27c87508a0604a4cfb97934c62a1e09eca523a460e912c35be9d749a8546f21 WatchSource:0}: Error finding container a27c87508a0604a4cfb97934c62a1e09eca523a460e912c35be9d749a8546f21: Status 404 returned error can't find the container with id a27c87508a0604a4cfb97934c62a1e09eca523a460e912c35be9d749a8546f21
Jul 07 20:01:12.138730 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.138710    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36955712_fb96_436a_b7ab_bc4bb2858822.slice/crio-2a5ea1abddc207c57c3a4f5ff4f90dbf7268531010def821a72c701dd4074743 WatchSource:0}: Error finding container 2a5ea1abddc207c57c3a4f5ff4f90dbf7268531010def821a72c701dd4074743: Status 404 returned error can't find the container with id 2a5ea1abddc207c57c3a4f5ff4f90dbf7268531010def821a72c701dd4074743
Jul 07 20:01:12.140467 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.140302    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09129cef_94af_4411_a135_34a093fb642d.slice/crio-aac20b15c3a856c4675dbb69d53f90a95a84853294442dbf0a0959e65ad9d928 WatchSource:0}: Error finding container aac20b15c3a856c4675dbb69d53f90a95a84853294442dbf0a0959e65ad9d928: Status 404 returned error can't find the container with id aac20b15c3a856c4675dbb69d53f90a95a84853294442dbf0a0959e65ad9d928
Jul 07 20:01:12.141034 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.141012    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f91be0c_74f0_4df9_9b90_e8c82fad3f72.slice/crio-800a60a4525dba47d9262c9bbe2bc2de0593257a8ca0d22fe8fd97eb22d9b456 WatchSource:0}: Error finding container 800a60a4525dba47d9262c9bbe2bc2de0593257a8ca0d22fe8fd97eb22d9b456: Status 404 returned error can't find the container with id 800a60a4525dba47d9262c9bbe2bc2de0593257a8ca0d22fe8fd97eb22d9b456
Jul 07 20:01:12.141499 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:12.141483    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eab86221f4cc923c73e223abc50211e.slice/crio-8e9363ef6d95ecb817749b08933b10b24b5ff8de6af8d4d7ac2dad9a0f62ad8c WatchSource:0}: Error finding container 8e9363ef6d95ecb817749b08933b10b24b5ff8de6af8d4d7ac2dad9a0f62ad8c: Status 404 returned error can't find the container with id 8e9363ef6d95ecb817749b08933b10b24b5ff8de6af8d4d7ac2dad9a0f62ad8c
Jul 07 20:01:12.188177 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.188150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:12.188360 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.188253    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:12.188360 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.188303    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:13.188289524 +0000 UTC m=+4.028786380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:12.288499 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.288463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:12.288717 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.288622    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:12.288717 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.288642    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:12.288717 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.288654    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:12.288717 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:12.288711    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:13.288694035 +0000 UTC m=+4.129190891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:12.519958 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.519824    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:56:11 +0000 UTC" deadline="2028-01-02 18:40:39.194798222 +0000 UTC"
Jul 07 20:01:12.519958 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.519898    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13054h39m26.674904339s"
Jul 07 20:01:12.588728 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.588688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerStarted","Data":"800a60a4525dba47d9262c9bbe2bc2de0593257a8ca0d22fe8fd97eb22d9b456"}
Jul 07 20:01:12.589935 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.589906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpgxw" event={"ID":"c57dccef-fbed-4ee2-9852-9760f1285278","Type":"ContainerStarted","Data":"a27c87508a0604a4cfb97934c62a1e09eca523a460e912c35be9d749a8546f21"}
Jul 07 20:01:12.591158 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.591134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7b2cd" event={"ID":"d84c0b72-fe1e-4aa1-9b7f-aed514282415","Type":"ContainerStarted","Data":"3fa053de13c7e7ecdc9c5b0256e336292c21f18bf16f9bd8a67d63ad1ffb802a"}
Jul 07 20:01:12.592330 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.592307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal" event={"ID":"6eab86221f4cc923c73e223abc50211e","Type":"ContainerStarted","Data":"8e9363ef6d95ecb817749b08933b10b24b5ff8de6af8d4d7ac2dad9a0f62ad8c"}
Jul 07 20:01:12.593412 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.593391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7vlt" event={"ID":"09129cef-94af-4411-a135-34a093fb642d","Type":"ContainerStarted","Data":"aac20b15c3a856c4675dbb69d53f90a95a84853294442dbf0a0959e65ad9d928"}
Jul 07 20:01:12.594631 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.594608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mclb4" event={"ID":"36955712-fb96-436a-b7ab-bc4bb2858822","Type":"ContainerStarted","Data":"2a5ea1abddc207c57c3a4f5ff4f90dbf7268531010def821a72c701dd4074743"}
Jul 07 20:01:12.595719 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.595698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhg64" event={"ID":"194dcf45-e49c-40c5-954a-aeb1f7c29a45","Type":"ContainerStarted","Data":"fddbd89735e6579ed72691477bea69cc06809b2de8b530d091e00beab3055e7c"}
Jul 07 20:01:12.597038 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.597018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"e672752dda70a9e7493a2f1af582cbb5be53a90c1a89e77251f87762041afe37"}
Jul 07 20:01:12.598172 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.598143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r7wd" event={"ID":"09042a1f-f767-4f55-bcab-76147adceb5e","Type":"ContainerStarted","Data":"486e494aa23dad6b398129f23a42be1cc96524de0a123e9de08b6d396e1cccad"}
Jul 07 20:01:12.599364 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:12.599335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw" event={"ID":"2a0a027f-d75f-4621-ba21-8ea1506ffab1","Type":"ContainerStarted","Data":"42a7db26d07fbbf20208654edbcd4b279391ffc42864862db7c86fbba888d236"}
Jul 07 20:01:13.094351 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.094313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:13.094575 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.094556    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:13.094684 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.094643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:15.094623901 +0000 UTC m=+5.935120760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:13.195416 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.195376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:13.195627 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.195547    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:13.195708 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.195630    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:15.195609449 +0000 UTC m=+6.036106320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:13.296217 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.296164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:13.296395 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.296372    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:13.296395 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.296394    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:13.296516 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.296407    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:13.296516 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.296469    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:15.296451365 +0000 UTC m=+6.136948256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:13.520290 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.520174    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:56:11 +0000 UTC" deadline="2028-01-07 00:32:29.620174319 +0000 UTC"
Jul 07 20:01:13.520290 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.520209    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13156h31m16.099969076s"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.584480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.584627    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.585019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.585112    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:13.585175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:13.585409 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:13.585250    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:14.622737 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:14.622468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal" event={"ID":"66d40220305fe03479bbe46175f2cd79","Type":"ContainerStarted","Data":"61bc8551c5a7052097b45de4068d5e001647fa2da9558f78f65a9ba832f4331f"}
Jul 07 20:01:15.111881 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.111775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:15.112054 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.112009    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:15.112115 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.112072    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:19.11205383 +0000 UTC m=+9.952550686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:15.212996 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.212960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:15.213170 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.213086    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:15.213170 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.213145    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:19.213127796 +0000 UTC m=+10.053624664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:15.315978 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.315276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:15.315978 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.315457    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:15.315978 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.315482    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:15.315978 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.315496    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:15.315978 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.315567    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:19.31554927 +0000 UTC m=+10.156046141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:15.580651 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.580534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:15.580803 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.580533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:15.580803 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.580687    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:15.580803 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:15.580706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:15.580955 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.580807    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:15.580955 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:15.580896    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:17.579905 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:17.579762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:17.580355 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:17.579915    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:17.580355 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:17.579978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:17.580355 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:17.580045    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:17.580522 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:17.580390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:17.580522 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:17.580477    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:19.146088 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.146047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:19.146568 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.146172    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:19.146568 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.146248    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:27.146227957 +0000 UTC m=+17.986724827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:19.247355 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.247285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:19.247556 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.247434    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:19.247556 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.247496    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:27.247477569 +0000 UTC m=+18.087974442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:19.348448 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.348412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:19.348661 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.348633    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:19.348661 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.348653    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:19.348780 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.348666    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:19.348780 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.348728    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:27.3487091 +0000 UTC m=+18.189205960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:19.580939 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.580900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:19.581104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.580990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:19.581104 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.580989    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:19.581219 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:19.581106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:19.581219 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.581168    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:19.581219 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:19.581101    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:21.583861 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:21.583828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:21.583861 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:21.583845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:21.583861 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:21.583855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:21.584404 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:21.583958    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:21.584404 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:21.584058    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:21.584404 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:21.584126    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:23.580220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.580182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:23.580584 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.580182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:23.580584 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.580307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:23.580584 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:23.580312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:23.580584 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:23.580424    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:23.580584 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:23.580504    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:23.642274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.642218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7b2cd" event={"ID":"d84c0b72-fe1e-4aa1-9b7f-aed514282415","Type":"ContainerStarted","Data":"3614e78c4b3e8750d3d4ad3b2a5684f4d871344b52924be10e6579bfd8a6b87c"}
Jul 07 20:01:23.662554 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.662496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7b2cd" podStartSLOduration=3.941560074 podStartE2EDuration="14.662474921s" totalImagesPullingTime="10.720914847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:23.662411549 +0000 UTC m=+14.502908449" watchObservedRunningTime="2026-07-07 20:01:23.662474921 +0000 UTC m=+14.502971800"
Jul 07 20:01:23.663080 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:23.663040    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-113.ec2.internal" podStartSLOduration=12.663030139 podStartE2EDuration="12.663030139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:14.644705817 +0000 UTC m=+5.485202714" watchObservedRunningTime="2026-07-07 20:01:23.663030139 +0000 UTC m=+14.503527020"
Jul 07 20:01:24.646185 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.645942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerStarted","Data":"4fafa2f52d89d505376461ed3950d82f1e96c76bafc32ebe2b5bfd817b158e51"}
Jul 07 20:01:24.647625 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.647580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpgxw" event={"ID":"c57dccef-fbed-4ee2-9852-9760f1285278","Type":"ContainerStarted","Data":"499090b4cc28502c7f2829a55aadf3bdc32111da17e2b3fe1bc350f70b9e1067"}
Jul 07 20:01:24.649126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.649090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal" event={"ID":"6eab86221f4cc923c73e223abc50211e","Type":"ContainerStarted","Data":"04669c31d35d16814854a9899bb40bd85d4e2ed1ef0d73ae86df586164c4d4e1"}
Jul 07 20:01:24.650602 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.650564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mclb4" event={"ID":"36955712-fb96-436a-b7ab-bc4bb2858822","Type":"ContainerStarted","Data":"40833289d34013c99cf69666dcdcd22adbe0e0d676b5a3052f3b83e421c46d38"}
Jul 07 20:01:24.652070 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.652045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhg64" event={"ID":"194dcf45-e49c-40c5-954a-aeb1f7c29a45","Type":"ContainerStarted","Data":"480af27b876157a6ead2af511bbfdc51f7aca4ef47bd409f0411ab4d74e2a7f5"}
Jul 07 20:01:24.653764 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.653738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r7wd" event={"ID":"09042a1f-f767-4f55-bcab-76147adceb5e","Type":"ContainerStarted","Data":"4e5bcaa12256ab844140f41e2ddd7a7b09d1c139050ca201cc680664aa09358a"}
Jul 07 20:01:24.655220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.655200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw" event={"ID":"2a0a027f-d75f-4621-ba21-8ea1506ffab1","Type":"ContainerStarted","Data":"80ba102a6e87cf04e3e15864389f3cf84fdd020c53c941e8232ea68dfc83e67b"}
Jul 07 20:01:24.698888 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.698831    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mclb4" podStartSLOduration=4.952542941 podStartE2EDuration="15.698814892s" totalImagesPullingTime="10.746271951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:24.698798835 +0000 UTC m=+15.539295734" watchObservedRunningTime="2026-07-07 20:01:24.698814892 +0000 UTC m=+15.539311806"
Jul 07 20:01:24.738900 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.738832    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8r7wd" podStartSLOduration=4.686609379 podStartE2EDuration="15.738811702s" totalImagesPullingTime="11.052202323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:24.738784515 +0000 UTC m=+15.579281414" watchObservedRunningTime="2026-07-07 20:01:24.738811702 +0000 UTC m=+15.579308580"
Jul 07 20:01:24.766809 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.766693    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lhg64" podStartSLOduration=5.108354085 podStartE2EDuration="15.766671529s" totalImagesPullingTime="10.658317444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:24.764937073 +0000 UTC m=+15.605433973" watchObservedRunningTime="2026-07-07 20:01:24.766671529 +0000 UTC m=+15.607168409"
Jul 07 20:01:24.788018 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:24.787953    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cpgxw" podStartSLOduration=5.132780112 podStartE2EDuration="15.787930846s" totalImagesPullingTime="10.655150734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:24.78692092 +0000 UTC m=+15.627417823" watchObservedRunningTime="2026-07-07 20:01:24.787930846 +0000 UTC m=+15.628427726"
Jul 07 20:01:25.580691 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:25.580659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:25.580867 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:25.580801    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:25.580867 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:25.580659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:25.581009 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:25.580897    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:25.581009 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:25.580659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:25.581009 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:25.580966    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:26.516666 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:26.516561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:26.517370 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:26.517326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:27.208423 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.208382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:27.208632 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.208505    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:27.208632 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.208574    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:43.208554478 +0000 UTC m=+34.049051335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:27.309111 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.309079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:27.309278 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.309229    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:27.309349 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.309286    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:43.309271561 +0000 UTC m=+34.149768417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:27.410035 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.410000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:27.410218 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.410176    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:27.410218 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.410199    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:27.410218 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.410212    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:27.410371 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.410277    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:43.41025749 +0000 UTC m=+34.250754346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:27.580334 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.580289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:27.580334 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.580326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:27.581022 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.580293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:27.581022 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.580455    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:27.581022 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.580650    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:27.581022 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:27.580752    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:27.661606 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:27.661559    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 20:01:28.665152 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:28.665122    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="4fafa2f52d89d505376461ed3950d82f1e96c76bafc32ebe2b5bfd817b158e51" exitCode=0
Jul 07 20:01:28.665805 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:28.665205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"4fafa2f52d89d505376461ed3950d82f1e96c76bafc32ebe2b5bfd817b158e51"}
Jul 07 20:01:28.667573 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:28.667540    2562 generic.go:356] "Generic (PLEG): container finished" podID="6eab86221f4cc923c73e223abc50211e" containerID="04669c31d35d16814854a9899bb40bd85d4e2ed1ef0d73ae86df586164c4d4e1" exitCode=0
Jul 07 20:01:28.667709 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:28.667623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal" event={"ID":"6eab86221f4cc923c73e223abc50211e","Type":"ContainerDied","Data":"04669c31d35d16814854a9899bb40bd85d4e2ed1ef0d73ae86df586164c4d4e1"}
Jul 07 20:01:29.580547 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:29.580513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:29.580753 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:29.580643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:29.580753 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:29.580656    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:29.580868 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:29.580754    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:29.580868 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:29.580830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:29.580969 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:29.580943    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:31.579921 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:31.579889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:31.579921 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:31.579914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:31.580440 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:31.579927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:31.580440 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:31.580027    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:31.580440 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:31.580170    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:31.580440 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:31.580252    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:32.353668 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.353482    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 20:01:32.532092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.530804    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T20:01:32.353665605Z","UUID":"db36850f-0f58-46c6-bd3e-01f6e14dcceb","Handler":null,"Name":"","Endpoint":""}
Jul 07 20:01:32.533199 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.533181    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 20:01:32.533307 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.533223    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 20:01:32.678167 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.678134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal" event={"ID":"6eab86221f4cc923c73e223abc50211e","Type":"ContainerStarted","Data":"a760552f049b8efb5b0b2292541cd8712152c0e2806adb2cce8daa6634db36d4"}
Jul 07 20:01:32.679618 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.679579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7vlt" event={"ID":"09129cef-94af-4411-a135-34a093fb642d","Type":"ContainerStarted","Data":"b3708d31505fcfe2153b6c1dbe015dfe116be48ec48fa926cfa4a5dcfe9f04d5"}
Jul 07 20:01:32.682433 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"d95229c33d8a4202dca42559d95b95e0576c612b53ea4b3542d64cc5a3e001fc"}
Jul 07 20:01:32.682543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"ae3adec842cde4a764d3d415ab6a515a109a4a80707503d1bc1dd6fe915a5793"}
Jul 07 20:01:32.682543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"bbdc3573acdb9fc8d661b323ebc0c0720a28f8d56565ea84284ddb3e586a31b5"}
Jul 07 20:01:32.682683 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"7a52c73411dc2b3b3f6c3f943aecb45f52d87fa4a3616965bc57941edf29e4bc"}
Jul 07 20:01:32.682683 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682602    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"774efd9b66c0e2a10a8ae738df26a73579f4c7024043635d873d3b11e80ee7d8"}
Jul 07 20:01:32.682683 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.682644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"ba2d9504ac5fa89abb50ab6e1b0bc4eb9fd6a4866d65b5b4688dc7391465f68b"}
Jul 07 20:01:32.684118 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.684094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw" event={"ID":"2a0a027f-d75f-4621-ba21-8ea1506ffab1","Type":"ContainerStarted","Data":"692fae69515f9deb27d6bc22176b50c09bc95a3b5ae63c5ffa9581ce510df830"}
Jul 07 20:01:32.704247 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.704200    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-113.ec2.internal" podStartSLOduration=21.704187098 podStartE2EDuration="21.704187098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:32.704119469 +0000 UTC m=+23.544616369" watchObservedRunningTime="2026-07-07 20:01:32.704187098 +0000 UTC m=+23.544683976"
Jul 07 20:01:32.734432 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:32.734385    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m7vlt" podStartSLOduration=3.6993641 podStartE2EDuration="23.734372932s" totalImagesPullingTime="20.035008832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:32.733033204 +0000 UTC m=+23.573530113" watchObservedRunningTime="2026-07-07 20:01:32.734372932 +0000 UTC m=+23.574869817"
Jul 07 20:01:33.580472 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:33.580434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:33.580780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:33.580434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:33.580780 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:33.580574    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:33.580780 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:33.580584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:33.580780 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:33.580700    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:33.581018 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:33.580791    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:34.690761 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:34.690729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw" event={"ID":"2a0a027f-d75f-4621-ba21-8ea1506ffab1","Type":"ContainerStarted","Data":"a4942c6ffa225bba5eceece2e2887a7cb36a980d24c0a8db6f9d5d94c2acd1fe"}
Jul 07 20:01:35.579842 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.579807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:35.580040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.579807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:35.580040 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:35.579906    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:35.580040 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:35.579981    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:35.580040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.579816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:35.580201 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:35.580108    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:35.696334 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.696295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"61e838071763990a321fc9b4b7e4002215f2752db9ad01ebf8db478c25707cf0"}
Jul 07 20:01:35.862894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.862809    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:35.863055 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.862965    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 20:01:35.863462 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.863433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lhg64"
Jul 07 20:01:35.889740 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:35.889688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4gw" podStartSLOduration=6.41645429 podStartE2EDuration="26.88967352s" totalImagesPullingTime="20.47321923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:34.715196258 +0000 UTC m=+25.555693137" watchObservedRunningTime="2026-07-07 20:01:35.88967352 +0000 UTC m=+26.730170398"
Jul 07 20:01:37.580839 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.580569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:37.581528 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.580575    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:37.581528 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:37.580939    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:37.581528 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:37.581037    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:37.581528 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.580568    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:37.581528 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:37.581176    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:37.706031 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.705952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" event={"ID":"8254250f-135c-4816-8cb2-ee28028097f4","Type":"ContainerStarted","Data":"9b542dc9dc15ed3d7686218d27de1c311e232a32ea7f1be743a857ed46b31190"}
Jul 07 20:01:37.706306 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.706281    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:37.706411 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.706356    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:37.723478 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.723454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:37.803759 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:37.803711    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn" podStartSLOduration=8.757020293 podStartE2EDuration="28.803690637s" totalImagesPullingTime="20.046670344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:37.753662045 +0000 UTC m=+28.594158948" watchObservedRunningTime="2026-07-07 20:01:37.803690637 +0000 UTC m=+28.644187524"
Jul 07 20:01:38.708456 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:38.708428    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:38.723109 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:38.723078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.581774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.581876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.581916    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.581937    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.581983    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:39.582238 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.582047    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:39.711553 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.711493    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="3998f85a27675fde919047b0fbe9e20e1a1f34462520c00ab44e59920b3c6ef7" exitCode=0
Jul 07 20:01:39.712039 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.711564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"3998f85a27675fde919047b0fbe9e20e1a1f34462520c00ab44e59920b3c6ef7"}
Jul 07 20:01:39.794343 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.794314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6kfsv"]
Jul 07 20:01:39.794495 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.794413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:39.794535 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.794500    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:39.801275 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.801249    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ss8j7"]
Jul 07 20:01:39.801414 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.801334    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:39.801464 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.801419    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:39.801759 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.801739    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ggpz"]
Jul 07 20:01:39.801857 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:39.801807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:39.801913 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:39.801887    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:41.583662 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:41.583359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:41.583997 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:41.583407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:41.583997 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:41.583701    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:41.583997 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:41.583408    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:41.583997 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:41.583775    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:41.583997 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:41.583842    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:41.717359 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:41.717325    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="1893e97f9614061866bce2c56e414deb060b7fd03601df741803d118fa6b29eb" exitCode=0
Jul 07 20:01:41.717515 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:41.717365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"1893e97f9614061866bce2c56e414deb060b7fd03601df741803d118fa6b29eb"}
Jul 07 20:01:42.721955 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:42.721926    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="420d32b3cbfc2420d0714d2a0fa2989d8868503ddb9e123fbaab8d423e2fdd20" exitCode=0
Jul 07 20:01:42.721955 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:42.721965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"420d32b3cbfc2420d0714d2a0fa2989d8868503ddb9e123fbaab8d423e2fdd20"}
Jul 07 20:01:43.224698 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.224665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:43.224847 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.224786    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:43.224847 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.224841    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret podName:31f67891-abed-4ca5-b2d1-1c4a7e3b5516 nodeName:}" failed. No retries permitted until 2026-07-07 20:02:15.224826925 +0000 UTC m=+66.065323782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret") pod "global-pull-secret-syncer-ss8j7" (UID: "31f67891-abed-4ca5-b2d1-1c4a7e3b5516") : object "kube-system"/"original-pull-secret" not registered
Jul 07 20:01:43.325543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.325509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:43.325856 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.325659    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:43.325856 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.325737    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs podName:0d06f8fd-5135-4622-ac72-214644d5e7b1 nodeName:}" failed. No retries permitted until 2026-07-07 20:02:15.325717468 +0000 UTC m=+66.166214349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs") pod "network-metrics-daemon-6kfsv" (UID: "0d06f8fd-5135-4622-ac72-214644d5e7b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 20:01:43.426719 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.426680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:43.426918 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.426849    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 20:01:43.426918 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.426870    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 20:01:43.426918 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.426882    2562 projected.go:196] Error preparing data for projected volume kube-api-access-wgnh8 for pod openshift-network-diagnostics/network-check-target-5ggpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:43.427079 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.426932    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8 podName:0418395f-e7d5-450f-8623-902b9b3bddb0 nodeName:}" failed. No retries permitted until 2026-07-07 20:02:15.42691764 +0000 UTC m=+66.267414509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgnh8" (UniqueName: "kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8") pod "network-check-target-5ggpz" (UID: "0418395f-e7d5-450f-8623-902b9b3bddb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 20:01:43.582691 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.582659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:43.582691 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.582688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:43.582888 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:43.582659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:43.582888 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.582767    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ggpz" podUID="0418395f-e7d5-450f-8623-902b9b3bddb0"
Jul 07 20:01:43.582888 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.582830    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kfsv" podUID="0d06f8fd-5135-4622-ac72-214644d5e7b1"
Jul 07 20:01:43.582979 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:43.582902    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ss8j7" podUID="31f67891-abed-4ca5-b2d1-1c4a7e3b5516"
Jul 07 20:01:44.988754 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:44.988683    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-113.ec2.internal" event="NodeReady"
Jul 07 20:01:44.989175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:44.988803    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 20:01:45.074107 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.074073    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:01:45.106626 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.106576    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6mhgp"]
Jul 07 20:01:45.106788 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.106697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.112146 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.112126    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 20:01:45.112393 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.112380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 20:01:45.112500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.112463    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 20:01:45.118702 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.118677    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fmqz4\""
Jul 07 20:01:45.120337 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.120313    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-65qjr"]
Jul 07 20:01:45.120439 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.120386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.122038 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.122019    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 20:01:45.127475 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.127292    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-52pqs\""
Jul 07 20:01:45.127616 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.127550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 20:01:45.127692 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.127639    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 20:01:45.127945 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.127850    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 20:01:45.138041 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.138018    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:01:45.138166 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.138111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.142216 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.142198    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6xh9\""
Jul 07 20:01:45.142893 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.142872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 20:01:45.142999 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.142899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 20:01:45.160017 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.159852    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mhgp"]
Jul 07 20:01:45.160781 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.160760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65qjr"]
Jul 07 20:01:45.239500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56431755-26ca-4a64-8d7a-703ae2b2cc4a-cert\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.239500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.239500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqstt\" (UniqueName: \"kubernetes.io/projected/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-kube-api-access-sqstt\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.239500 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-tmp-dir\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxf5\" (UniqueName: \"kubernetes.io/projected/56431755-26ca-4a64-8d7a-703ae2b2cc4a-kube-api-access-rjxf5\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.239817 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-config-volume\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.240040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.240040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.239857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5c9\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340736 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340823 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5c9\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340823 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56431755-26ca-4a64-8d7a-703ae2b2cc4a-cert\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.340823 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.340823 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqstt\" (UniqueName: \"kubernetes.io/projected/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-kube-api-access-sqstt\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-tmp-dir\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxf5\" (UniqueName: \"kubernetes.io/projected/56431755-26ca-4a64-8d7a-703ae2b2cc4a-kube-api-access-rjxf5\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.340998 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.340987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-config-volume\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.341093    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.341185    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls podName:d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:45.841148639 +0000 UTC m=+36.681645513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls") pod "dns-default-65qjr" (UID: "d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6") : secret "dns-default-metrics-tls" not found
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.341098    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.341214    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb4d9f97c-pznkl: secret "image-registry-tls" not found
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341230    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-tmp-dir\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.341274 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.341246    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls podName:00bba3f8-aadd-44da-962f-dd639e35b734 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:45.841235783 +0000 UTC m=+36.681732649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls") pod "image-registry-6bb4d9f97c-pznkl" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734") : secret "image-registry-tls" not found
Jul 07 20:01:45.341781 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341696    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-config-volume\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.341868 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.341851    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.342132 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.342113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.345765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.345738    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.345875 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.345764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.345875 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.345769    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56431755-26ca-4a64-8d7a-703ae2b2cc4a-cert\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.359332 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.359069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.359332 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.359219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxf5\" (UniqueName: \"kubernetes.io/projected/56431755-26ca-4a64-8d7a-703ae2b2cc4a-kube-api-access-rjxf5\") pod \"ingress-canary-6mhgp\" (UID: \"56431755-26ca-4a64-8d7a-703ae2b2cc4a\") " pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.359865 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.359841    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5c9\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.361685 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.361664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqstt\" (UniqueName: \"kubernetes.io/projected/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-kube-api-access-sqstt\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.431236 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.431204    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mhgp"
Jul 07 20:01:45.580182 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.580154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:01:45.580314 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.580187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:01:45.580314 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.580155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:01:45.587306 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.586576    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcjbq\""
Jul 07 20:01:45.587508 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.586676    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 20:01:45.587625 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.586790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 20:01:45.588353 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.586899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 20:01:45.588353 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.587232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mcw2j\""
Jul 07 20:01:45.588353 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.587867    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 20:01:45.643124 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.643090    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mhgp"]
Jul 07 20:01:45.647340 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:45.647319    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56431755_26ca_4a64_8d7a_703ae2b2cc4a.slice/crio-cd9634b113be44f53c89064673fc31608e2a923f3c82f7ffdd0d89fcc8f414df WatchSource:0}: Error finding container cd9634b113be44f53c89064673fc31608e2a923f3c82f7ffdd0d89fcc8f414df: Status 404 returned error can't find the container with id cd9634b113be44f53c89064673fc31608e2a923f3c82f7ffdd0d89fcc8f414df
Jul 07 20:01:45.730069 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.730024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mhgp" event={"ID":"56431755-26ca-4a64-8d7a-703ae2b2cc4a","Type":"ContainerStarted","Data":"cd9634b113be44f53c89064673fc31608e2a923f3c82f7ffdd0d89fcc8f414df"}
Jul 07 20:01:45.844806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.844672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:45.844800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.844836    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.844905    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls podName:d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:46.844884368 +0000 UTC m=+37.685381224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls") pod "dns-default-65qjr" (UID: "d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6") : secret "dns-default-metrics-tls" not found
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.844906    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.844919    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb4d9f97c-pznkl: secret "image-registry-tls" not found
Jul 07 20:01:45.844964 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:45.844967    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls podName:00bba3f8-aadd-44da-962f-dd639e35b734 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:46.844955279 +0000 UTC m=+37.685452135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls") pod "image-registry-6bb4d9f97c-pznkl" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734") : secret "image-registry-tls" not found
Jul 07 20:01:46.852336 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:46.852291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:46.852389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:46.852471    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:46.852494    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb4d9f97c-pznkl: secret "image-registry-tls" not found
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:46.852509    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:46.852564    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls podName:00bba3f8-aadd-44da-962f-dd639e35b734 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:48.852543614 +0000 UTC m=+39.693040475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls") pod "image-registry-6bb4d9f97c-pznkl" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734") : secret "image-registry-tls" not found
Jul 07 20:01:46.853027 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:46.852582    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls podName:d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:48.852573481 +0000 UTC m=+39.693070343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls") pod "dns-default-65qjr" (UID: "d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6") : secret "dns-default-metrics-tls" not found
Jul 07 20:01:48.869730 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:48.869694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:48.869792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:48.869855    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:48.869872    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb4d9f97c-pznkl: secret "image-registry-tls" not found
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:48.869933    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls podName:00bba3f8-aadd-44da-962f-dd639e35b734 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:52.869914481 +0000 UTC m=+43.710411340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls") pod "image-registry-6bb4d9f97c-pznkl" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734") : secret "image-registry-tls" not found
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:48.869975    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 20:01:48.870210 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:48.870042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls podName:d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6 nodeName:}" failed. No retries permitted until 2026-07-07 20:01:52.870028263 +0000 UTC m=+43.710525118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls") pod "dns-default-65qjr" (UID: "d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6") : secret "dns-default-metrics-tls" not found
Jul 07 20:01:49.742907 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:49.742867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mhgp" event={"ID":"56431755-26ca-4a64-8d7a-703ae2b2cc4a","Type":"ContainerStarted","Data":"7e32d8eea96c2d9f53549e3af01a50dd82f447a0430cbc39498fb38aaa7b4cb8"}
Jul 07 20:01:49.745904 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:49.745879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerStarted","Data":"bdd7dee997850a0851919dde0d1b7d79b4d43f2a049c972ae197ce982c6e84e4"}
Jul 07 20:01:49.765769 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:49.765538    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6mhgp" podStartSLOduration=0.896512423 podStartE2EDuration="4.765518847s" totalImagesPullingTime="3.869006424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:49.765041472 +0000 UTC m=+40.605538375" watchObservedRunningTime="2026-07-07 20:01:49.765518847 +0000 UTC m=+40.606015723"
Jul 07 20:01:50.061168 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.061137    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z9pmf"]
Jul 07 20:01:50.075165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.075140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.078628 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.078606    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b4fhd\""
Jul 07 20:01:50.078904 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.078881    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 20:01:50.079136 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.079119    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 20:01:50.079250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.079164    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 20:01:50.079826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.079799    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 20:01:50.080801 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.080781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9pmf"]
Jul 07 20:01:50.178345 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.178300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa947f06-5290-44ae-899d-7ae553c9b2ec-data-volume\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.178345 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.178341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.178543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.178357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6j4x\" (UniqueName: \"kubernetes.io/projected/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-api-access-g6j4x\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.178543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.178474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.178543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.178515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa947f06-5290-44ae-899d-7ae553c9b2ec-crio-socket\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.278872 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.278829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa947f06-5290-44ae-899d-7ae553c9b2ec-crio-socket\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279029 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.278896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa947f06-5290-44ae-899d-7ae553c9b2ec-data-volume\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279029 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.278943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279029 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.278962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6j4x\" (UniqueName: \"kubernetes.io/projected/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-api-access-g6j4x\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279140 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.279033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279140 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.279044    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 20:01:50.279140 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.279070    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa947f06-5290-44ae-899d-7ae553c9b2ec-crio-socket\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.279140 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.279124    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:50.779108664 +0000 UTC m=+41.619605523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : configmap "kube-rbac-proxy" not found
Jul 07 20:01:50.279275 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.279157    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:50.279275 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.279223    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:50.779208112 +0000 UTC m=+41.619704988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:50.279384 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.279274    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa947f06-5290-44ae-899d-7ae553c9b2ec-data-volume\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.293626 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.293584    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6j4x\" (UniqueName: \"kubernetes.io/projected/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-api-access-g6j4x\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.375886 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.375811    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"]
Jul 07 20:01:50.396173 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.396145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"]
Jul 07 20:01:50.396318 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.396240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"
Jul 07 20:01:50.399521 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.399491    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 20:01:50.399843 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.399820    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 20:01:50.399843 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.399837    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rkzbr\""
Jul 07 20:01:50.480522 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.480487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcjf\" (UniqueName: \"kubernetes.io/projected/bdf692d3-7e81-4163-b366-70f795e09a6a-kube-api-access-dlcjf\") pod \"migrator-d57d58cc9-v2fkd\" (UID: \"bdf692d3-7e81-4163-b366-70f795e09a6a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"
Jul 07 20:01:50.581194 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.581155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcjf\" (UniqueName: \"kubernetes.io/projected/bdf692d3-7e81-4163-b366-70f795e09a6a-kube-api-access-dlcjf\") pod \"migrator-d57d58cc9-v2fkd\" (UID: \"bdf692d3-7e81-4163-b366-70f795e09a6a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"
Jul 07 20:01:50.591655 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.591634    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcjf\" (UniqueName: \"kubernetes.io/projected/bdf692d3-7e81-4163-b366-70f795e09a6a-kube-api-access-dlcjf\") pod \"migrator-d57d58cc9-v2fkd\" (UID: \"bdf692d3-7e81-4163-b366-70f795e09a6a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"
Jul 07 20:01:50.705220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.705139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"
Jul 07 20:01:50.750933 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.750762    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="bdd7dee997850a0851919dde0d1b7d79b4d43f2a049c972ae197ce982c6e84e4" exitCode=0
Jul 07 20:01:50.751087 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.750829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"bdd7dee997850a0851919dde0d1b7d79b4d43f2a049c972ae197ce982c6e84e4"}
Jul 07 20:01:50.782925 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.782890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.783080 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.783012    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:50.783150 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.783083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:50.783204 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.783136    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:51.78310638 +0000 UTC m=+42.623603245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:50.783204 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.783144    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 20:01:50.783300 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:50.783237    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:51.783217158 +0000 UTC m=+42.623714018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : configmap "kube-rbac-proxy" not found
Jul 07 20:01:50.860039 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:50.860011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd"]
Jul 07 20:01:50.863287 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:01:50.862852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf692d3_7e81_4163_b366_70f795e09a6a.slice/crio-f49e4056b0dd0916278d05b5a8036ca2e51437223abdc00807cd938286d6d1b4 WatchSource:0}: Error finding container f49e4056b0dd0916278d05b5a8036ca2e51437223abdc00807cd938286d6d1b4: Status 404 returned error can't find the container with id f49e4056b0dd0916278d05b5a8036ca2e51437223abdc00807cd938286d6d1b4
Jul 07 20:01:51.645877 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.645854    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpgxw_c57dccef-fbed-4ee2-9852-9760f1285278/dns-node-resolver/0.log"
Jul 07 20:01:51.756583 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.756542    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f91be0c-74f0-4df9-9b90-e8c82fad3f72" containerID="ec6afe2c0d490325523c20f59f524bda1116b5bd4698f5d38ff723cc377a6a5d" exitCode=0
Jul 07 20:01:51.756771 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.756619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerDied","Data":"ec6afe2c0d490325523c20f59f524bda1116b5bd4698f5d38ff723cc377a6a5d"}
Jul 07 20:01:51.758079 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.758054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd" event={"ID":"bdf692d3-7e81-4163-b366-70f795e09a6a","Type":"ContainerStarted","Data":"f49e4056b0dd0916278d05b5a8036ca2e51437223abdc00807cd938286d6d1b4"}
Jul 07 20:01:51.791536 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.791495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:51.791536 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:51.791614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:51.791906 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:51.791710    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 20:01:51.791906 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:51.791802    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:53.791781641 +0000 UTC m=+44.632278503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : configmap "kube-rbac-proxy" not found
Jul 07 20:01:51.792114 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:51.792050    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:51.792223 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:51.792120    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:53.79210139 +0000 UTC m=+44.632598264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:52.764279 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:52.764096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" event={"ID":"9f91be0c-74f0-4df9-9b90-e8c82fad3f72","Type":"ContainerStarted","Data":"b8779d2a7ad2ae07826a8c1cdbc3cbd486f0f71684b49490daef766221cf5be1"}
Jul 07 20:01:52.795089 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:52.795042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvmg4" podStartSLOduration=13.59567199 podStartE2EDuration="43.795024471s" totalImagesPullingTime="30.199352481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:52.792653207 +0000 UTC m=+43.633150100" watchObservedRunningTime="2026-07-07 20:01:52.795024471 +0000 UTC m=+43.635521348"
Jul 07 20:01:52.846571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:52.846540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mclb4_36955712-fb96-436a-b7ab-bc4bb2858822/node-ca/0.log"
Jul 07 20:01:52.900871 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:52.900837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:01:52.901036 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:52.900921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:01:52.901036 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:52.900996    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 20:01:52.901036 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:52.901019    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb4d9f97c-pznkl: secret "image-registry-tls" not found
Jul 07 20:01:52.901193 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:52.901083    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls podName:00bba3f8-aadd-44da-962f-dd639e35b734 nodeName:}" failed. No retries permitted until 2026-07-07 20:02:00.901062319 +0000 UTC m=+51.741559186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls") pod "image-registry-6bb4d9f97c-pznkl" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734") : secret "image-registry-tls" not found
Jul 07 20:01:52.901193 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:52.901081    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 20:01:52.901193 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:52.901177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls podName:d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6 nodeName:}" failed. No retries permitted until 2026-07-07 20:02:00.901158678 +0000 UTC m=+51.741655536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls") pod "dns-default-65qjr" (UID: "d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6") : secret "dns-default-metrics-tls" not found
Jul 07 20:01:53.448019 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.447923    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mhgp_56431755-26ca-4a64-8d7a-703ae2b2cc4a/serve-healthcheck-canary/0.log"
Jul 07 20:01:53.768268 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.768225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd" event={"ID":"bdf692d3-7e81-4163-b366-70f795e09a6a","Type":"ContainerStarted","Data":"9d268db03c99bbb49b585a4a63d88d32c45ea8954993543f615b89dc3410a0f3"}
Jul 07 20:01:53.768696 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.768283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd" event={"ID":"bdf692d3-7e81-4163-b366-70f795e09a6a","Type":"ContainerStarted","Data":"57d3279904ca8755e1310214f8ab0397ed86ebf65d1f86ed9a0c79df75570200"}
Jul 07 20:01:53.794083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.794032    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2fkd" podStartSLOduration=1.625574367 podStartE2EDuration="3.794016818s" totalImagesPullingTime="2.168442451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:01:53.792888501 +0000 UTC m=+44.633385398" watchObservedRunningTime="2026-07-07 20:01:53.794016818 +0000 UTC m=+44.634513699"
Jul 07 20:01:53.808046 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.808012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:53.808193 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:53.808077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:53.808193 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:53.808156    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:53.808193 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:53.808166    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 20:01:53.808288 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:53.808219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:57.808204706 +0000 UTC m=+48.648701561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:53.808288 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:53.808235    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:01:57.808229143 +0000 UTC m=+48.648725999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : configmap "kube-rbac-proxy" not found
Jul 07 20:01:57.842228 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:57.842191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:57.842766 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:01:57.842262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:01:57.842766 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:57.842356    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 20:01:57.842766 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:57.842391    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 20:01:57.842766 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:57.842407    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:02:05.842393704 +0000 UTC m=+56.682890561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : configmap "kube-rbac-proxy" not found
Jul 07 20:01:57.842766 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:01:57.842460    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls podName:aa947f06-5290-44ae-899d-7ae553c9b2ec nodeName:}" failed. No retries permitted until 2026-07-07 20:02:05.842439424 +0000 UTC m=+56.682936279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9pmf" (UID: "aa947f06-5290-44ae-899d-7ae553c9b2ec") : secret "insights-runtime-extractor-tls" not found
Jul 07 20:02:00.967546 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:00.967500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:02:00.967952 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:00.967605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:00.970826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:00.970796    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6-metrics-tls\") pod \"dns-default-65qjr\" (UID: \"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6\") " pod="openshift-dns/dns-default-65qjr"
Jul 07 20:02:00.970937 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:00.970886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"image-registry-6bb4d9f97c-pznkl\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") " pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:01.016974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.016931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:01.048425 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.048399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65qjr"
Jul 07 20:02:01.187478 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.187449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:02:01.194652 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:01.194629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bba3f8_aadd_44da_962f_dd639e35b734.slice/crio-d132d1cdf29cab2b1077b8f32d144e2fa7d6a8ae29590867db14970c948fbadf WatchSource:0}: Error finding container d132d1cdf29cab2b1077b8f32d144e2fa7d6a8ae29590867db14970c948fbadf: Status 404 returned error can't find the container with id d132d1cdf29cab2b1077b8f32d144e2fa7d6a8ae29590867db14970c948fbadf
Jul 07 20:02:01.218374 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.218297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65qjr"]
Jul 07 20:02:01.220864 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:01.220837    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50cfc2c_6c24_4903_872b_6c8e6ef5a9d6.slice/crio-256ebe566c1b49849232b5859b9d892d9f00f33f340de77953f0ab8c4f309d49 WatchSource:0}: Error finding container 256ebe566c1b49849232b5859b9d892d9f00f33f340de77953f0ab8c4f309d49: Status 404 returned error can't find the container with id 256ebe566c1b49849232b5859b9d892d9f00f33f340de77953f0ab8c4f309d49
Jul 07 20:02:01.788320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.788289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65qjr" event={"ID":"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6","Type":"ContainerStarted","Data":"256ebe566c1b49849232b5859b9d892d9f00f33f340de77953f0ab8c4f309d49"}
Jul 07 20:02:01.789776 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.789750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" event={"ID":"00bba3f8-aadd-44da-962f-dd639e35b734","Type":"ContainerStarted","Data":"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"}
Jul 07 20:02:01.789893 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.789789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" event={"ID":"00bba3f8-aadd-44da-962f-dd639e35b734","Type":"ContainerStarted","Data":"d132d1cdf29cab2b1077b8f32d144e2fa7d6a8ae29590867db14970c948fbadf"}
Jul 07 20:02:01.789966 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.789892    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:01.819428 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:01.819375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" podStartSLOduration=20.819359193 podStartE2EDuration="20.819359193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:01.817951705 +0000 UTC m=+52.658448604" watchObservedRunningTime="2026-07-07 20:02:01.819359193 +0000 UTC m=+52.659856059"
Jul 07 20:02:04.800430 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:04.800397    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65qjr" event={"ID":"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6","Type":"ContainerStarted","Data":"b49148928ae7ea127283c3cbd8eef40a6a29360154f03753c5d9fd13791806ac"}
Jul 07 20:02:04.800842 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:04.800457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65qjr" event={"ID":"d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6","Type":"ContainerStarted","Data":"528b4c1a199f24733540f51861f53d535f046082b1d7f211e5a448f0600ede39"}
Jul 07 20:02:04.800842 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:04.800498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-65qjr"
Jul 07 20:02:04.832605 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:04.829625    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-65qjr" podStartSLOduration=17.051457547 podStartE2EDuration="19.829582321s" totalImagesPullingTime="2.778124774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:04.829144688 +0000 UTC m=+55.669641811" watchObservedRunningTime="2026-07-07 20:02:04.829582321 +0000 UTC m=+55.670079199"
Jul 07 20:02:05.911232 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:05.911190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:02:05.911749 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:05.911295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:02:05.911899 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:05.911828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa947f06-5290-44ae-899d-7ae553c9b2ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:02:05.913561 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:05.913537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa947f06-5290-44ae-899d-7ae553c9b2ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9pmf\" (UID: \"aa947f06-5290-44ae-899d-7ae553c9b2ec\") " pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:02:05.984742 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:05.984709    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9pmf"
Jul 07 20:02:06.114536 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:06.114512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9pmf"]
Jul 07 20:02:06.116898 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:06.116865    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa947f06_5290_44ae_899d_7ae553c9b2ec.slice/crio-b9e1df8d2302cfc5ad51a9e98ae83b0dc52cf393f42027270b6c8fea9cfa0f66 WatchSource:0}: Error finding container b9e1df8d2302cfc5ad51a9e98ae83b0dc52cf393f42027270b6c8fea9cfa0f66: Status 404 returned error can't find the container with id b9e1df8d2302cfc5ad51a9e98ae83b0dc52cf393f42027270b6c8fea9cfa0f66
Jul 07 20:02:06.810681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:06.810641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9pmf" event={"ID":"aa947f06-5290-44ae-899d-7ae553c9b2ec","Type":"ContainerStarted","Data":"b9e1df8d2302cfc5ad51a9e98ae83b0dc52cf393f42027270b6c8fea9cfa0f66"}
Jul 07 20:02:10.724351 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:10.724265    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmdjn"
Jul 07 20:02:10.825058 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:10.825025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9pmf" event={"ID":"aa947f06-5290-44ae-899d-7ae553c9b2ec","Type":"ContainerStarted","Data":"7f514f7c039157af63f6c291aad6fdddf55a97aa4e1b6e0ff789ab6209bed4e3"}
Jul 07 20:02:11.830693 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:11.830655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9pmf" event={"ID":"aa947f06-5290-44ae-899d-7ae553c9b2ec","Type":"ContainerStarted","Data":"de4fd0db608ad417c6b83dcc21c6863a4f2775dd0f1e483518ccfe168cea4768"}
Jul 07 20:02:13.838982 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:13.838947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9pmf" event={"ID":"aa947f06-5290-44ae-899d-7ae553c9b2ec","Type":"ContainerStarted","Data":"e88e889934a6784dedfdd5d1bbddf732ced4aa4b6b55d19ddad2b641b9d175b2"}
Jul 07 20:02:13.869752 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:13.869704    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z9pmf" podStartSLOduration=16.643165825 podStartE2EDuration="23.86967204s" totalImagesPullingTime="7.226506215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:13.868791116 +0000 UTC m=+64.709288044" watchObservedRunningTime="2026-07-07 20:02:13.86967204 +0000 UTC m=+64.710168918"
Jul 07 20:02:14.806933 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:14.806907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-65qjr"
Jul 07 20:02:15.284268 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.284235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:02:15.287406 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.287384    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 20:02:15.297103 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.297081    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f67891-abed-4ca5-b2d1-1c4a7e3b5516-original-pull-secret\") pod \"global-pull-secret-syncer-ss8j7\" (UID: \"31f67891-abed-4ca5-b2d1-1c4a7e3b5516\") " pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:02:15.302050 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.302033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ss8j7"
Jul 07 20:02:15.385127 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.385088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:02:15.388302 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.388282    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 20:02:15.397744 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.397719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d06f8fd-5135-4622-ac72-214644d5e7b1-metrics-certs\") pod \"network-metrics-daemon-6kfsv\" (UID: \"0d06f8fd-5135-4622-ac72-214644d5e7b1\") " pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:02:15.430548 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.430519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ss8j7"]
Jul 07 20:02:15.433659 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:15.433632    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f67891_abed_4ca5_b2d1_1c4a7e3b5516.slice/crio-a1fa93aa6c08e08ca6eb0a1f8b2a8612a554076a80f76fe7688b5f906f94e926 WatchSource:0}: Error finding container a1fa93aa6c08e08ca6eb0a1f8b2a8612a554076a80f76fe7688b5f906f94e926: Status 404 returned error can't find the container with id a1fa93aa6c08e08ca6eb0a1f8b2a8612a554076a80f76fe7688b5f906f94e926
Jul 07 20:02:15.486158 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.486126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:02:15.489520 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.489501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 20:02:15.500297 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.500274    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 20:02:15.510366 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.510343    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgnh8\" (UniqueName: \"kubernetes.io/projected/0418395f-e7d5-450f-8623-902b9b3bddb0-kube-api-access-wgnh8\") pod \"network-check-target-5ggpz\" (UID: \"0418395f-e7d5-450f-8623-902b9b3bddb0\") " pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:02:15.598772 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.598699    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcjbq\""
Jul 07 20:02:15.606733 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.606718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:02:15.610315 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.610291    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mcw2j\""
Jul 07 20:02:15.617187 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.617166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kfsv"
Jul 07 20:02:15.738209 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.738168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ggpz"]
Jul 07 20:02:15.741679 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:15.741654    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0418395f_e7d5_450f_8623_902b9b3bddb0.slice/crio-19aec8adbec587bc7ecbbdb6d5649eb01eeeb06f4070ab33e2bdc2257dc79bfa WatchSource:0}: Error finding container 19aec8adbec587bc7ecbbdb6d5649eb01eeeb06f4070ab33e2bdc2257dc79bfa: Status 404 returned error can't find the container with id 19aec8adbec587bc7ecbbdb6d5649eb01eeeb06f4070ab33e2bdc2257dc79bfa
Jul 07 20:02:15.775190 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.775163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6kfsv"]
Jul 07 20:02:15.778276 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:15.778248    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d06f8fd_5135_4622_ac72_214644d5e7b1.slice/crio-cadce392c9c462a307efaadda69b72201475a2434b8e940353e7152db2fe7247 WatchSource:0}: Error finding container cadce392c9c462a307efaadda69b72201475a2434b8e940353e7152db2fe7247: Status 404 returned error can't find the container with id cadce392c9c462a307efaadda69b72201475a2434b8e940353e7152db2fe7247
Jul 07 20:02:15.847389 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.847354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ggpz" event={"ID":"0418395f-e7d5-450f-8623-902b9b3bddb0","Type":"ContainerStarted","Data":"19aec8adbec587bc7ecbbdb6d5649eb01eeeb06f4070ab33e2bdc2257dc79bfa"}
Jul 07 20:02:15.848565 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.848538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ss8j7" event={"ID":"31f67891-abed-4ca5-b2d1-1c4a7e3b5516","Type":"ContainerStarted","Data":"a1fa93aa6c08e08ca6eb0a1f8b2a8612a554076a80f76fe7688b5f906f94e926"}
Jul 07 20:02:15.849708 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:15.849653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kfsv" event={"ID":"0d06f8fd-5135-4622-ac72-214644d5e7b1","Type":"ContainerStarted","Data":"cadce392c9c462a307efaadda69b72201475a2434b8e940353e7152db2fe7247"}
Jul 07 20:02:17.813288 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.812988    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"]
Jul 07 20:02:17.816684 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.816500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:17.825444 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.825100    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 20:02:17.825444 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.825344    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 20:02:17.825580 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.825344    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vvvj5\""
Jul 07 20:02:17.825580 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.825541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 20:02:17.825705 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.825648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 20:02:17.904104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.904070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpdjq\" (UniqueName: \"kubernetes.io/projected/20914f9a-b98a-4f20-b992-e9b472393c30-kube-api-access-zpdjq\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:17.904290 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.904130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20914f9a-b98a-4f20-b992-e9b472393c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:17.929310 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.929274    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"]
Jul 07 20:02:17.932870 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.932831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:17.947708 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.947681    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 20:02:17.964291 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.964263    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"]
Jul 07 20:02:17.967739 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.967715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"]
Jul 07 20:02:17.967876 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.967829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:17.980275 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.980246    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 20:02:17.980779 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.980609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 20:02:17.980779 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.980693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 20:02:17.980779 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.980757    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 20:02:17.989599 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:17.989568    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"]
Jul 07 20:02:18.005282 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqkp\" (UniqueName: \"kubernetes.io/projected/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-kube-api-access-zvqkp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.005429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.005429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97023bc1-09f4-41cd-bb15-fac632b1442f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.005429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.005429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-tmp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.005429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20914f9a-b98a-4f20-b992-e9b472393c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:18.005615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdjq\" (UniqueName: \"kubernetes.io/projected/20914f9a-b98a-4f20-b992-e9b472393c30-kube-api-access-zpdjq\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:18.005615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.005615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.005615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9dfp\" (UniqueName: \"kubernetes.io/projected/97023bc1-09f4-41cd-bb15-fac632b1442f-kube-api-access-x9dfp\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.005615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.005606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.009478 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.009422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20914f9a-b98a-4f20-b992-e9b472393c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:18.018948 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.018869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"]
Jul 07 20:02:18.021479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.020653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpdjq\" (UniqueName: \"kubernetes.io/projected/20914f9a-b98a-4f20-b992-e9b472393c30-kube-api-access-zpdjq\") pod \"managed-serviceaccount-addon-agent-d6d75bcd-lh6tl\" (UID: \"20914f9a-b98a-4f20-b992-e9b472393c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:18.081530 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.081449    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:02:18.087552 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.087501    2562 patch_prober.go:28] interesting pod/image-registry-6bb4d9f97c-pznkl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 20:02:18.087732 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.087604    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 20:02:18.106901 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.106830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.106901 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.106885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.106921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9dfp\" (UniqueName: \"kubernetes.io/projected/97023bc1-09f4-41cd-bb15-fac632b1442f-kube-api-access-x9dfp\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.106947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.106977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqkp\" (UniqueName: \"kubernetes.io/projected/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-kube-api-access-zvqkp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.107009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.107033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97023bc1-09f4-41cd-bb15-fac632b1442f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.107060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.107131 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.107087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-tmp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.107501 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.107476    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-tmp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.108279 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.108254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97023bc1-09f4-41cd-bb15-fac632b1442f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.110544 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.110499    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.112704 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.112660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.113140 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.113100    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.113140 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.113132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-ca\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.113802 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.113762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97023bc1-09f4-41cd-bb15-fac632b1442f-hub\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.138171 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.138139    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9dfp\" (UniqueName: \"kubernetes.io/projected/97023bc1-09f4-41cd-bb15-fac632b1442f-kube-api-access-x9dfp\") pod \"cluster-proxy-proxy-agent-64fc84589-pknmt\" (UID: \"97023bc1-09f4-41cd-bb15-fac632b1442f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.142258 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.142223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"
Jul 07 20:02:18.148951 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.148896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqkp\" (UniqueName: \"kubernetes.io/projected/87ce61f6-29ee-4f05-b6eb-22e2d0df88d0-kube-api-access-zvqkp\") pod \"klusterlet-addon-workmgr-5577867494-tdqm2\" (UID: \"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.240447 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.240333    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df479756f-rz5h9"]
Jul 07 20:02:18.245083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.245055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.245681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.245464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:18.273056 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.272980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df479756f-rz5h9"]
Jul 07 20:02:18.280175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.280146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"
Jul 07 20:02:18.316017 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.315988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-ca-trust-extracted\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316164 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-installation-pull-secrets\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316164 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zh4\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-kube-api-access-c8zh4\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316164 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-tls\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316164 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-image-registry-private-configuration\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316421 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-trusted-ca\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316421 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-bound-sa-token\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.316421 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.316255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-certificates\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.321180 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.320958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl"]
Jul 07 20:02:18.321543 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:18.321457    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20914f9a_b98a_4f20_b992_e9b472393c30.slice/crio-b93f16c6e4f850e9e0af7418d37f635f48d53815dc253fc5588322f79797d266 WatchSource:0}: Error finding container b93f16c6e4f850e9e0af7418d37f635f48d53815dc253fc5588322f79797d266: Status 404 returned error can't find the container with id b93f16c6e4f850e9e0af7418d37f635f48d53815dc253fc5588322f79797d266
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.417616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-certificates\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.417677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-ca-trust-extracted\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-installation-pull-secrets\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-ca-trust-extracted\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zh4\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-kube-api-access-c8zh4\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-tls\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-image-registry-private-configuration\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-trusted-ca\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.418404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.418245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-bound-sa-token\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.420278 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.420252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-certificates\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.420278 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.420273    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-trusted-ca\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.424477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.423623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-installation-pull-secrets\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.424569 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.424489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-registry-tls\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.426770 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.426714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-image-registry-private-configuration\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.433143 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.433043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"]
Jul 07 20:02:18.440986 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.440954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-bound-sa-token\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.441093 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.440965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zh4\" (UniqueName: \"kubernetes.io/projected/4dfdb643-9e9e-46eb-ab0e-49df2c723e39-kube-api-access-c8zh4\") pod \"image-registry-df479756f-rz5h9\" (UID: \"4dfdb643-9e9e-46eb-ab0e-49df2c723e39\") " pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.443074 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:18.443036    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ce61f6_29ee_4f05_b6eb_22e2d0df88d0.slice/crio-162d6333cbbffe6b1c0d1bf923caeb2324ad2d7d964e6939bf705be79079abf2 WatchSource:0}: Error finding container 162d6333cbbffe6b1c0d1bf923caeb2324ad2d7d964e6939bf705be79079abf2: Status 404 returned error can't find the container with id 162d6333cbbffe6b1c0d1bf923caeb2324ad2d7d964e6939bf705be79079abf2
Jul 07 20:02:18.509275 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.509147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt"]
Jul 07 20:02:18.578211 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.578132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:18.726162 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:18.726078    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97023bc1_09f4_41cd_bb15_fac632b1442f.slice/crio-d4c8a26318b8226de632386bae265353bae423e797a1583d3886b1e1f7f46e38 WatchSource:0}: Error finding container d4c8a26318b8226de632386bae265353bae423e797a1583d3886b1e1f7f46e38: Status 404 returned error can't find the container with id d4c8a26318b8226de632386bae265353bae423e797a1583d3886b1e1f7f46e38
Jul 07 20:02:18.862370 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.862325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt" event={"ID":"97023bc1-09f4-41cd-bb15-fac632b1442f","Type":"ContainerStarted","Data":"d4c8a26318b8226de632386bae265353bae423e797a1583d3886b1e1f7f46e38"}
Jul 07 20:02:18.863648 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.863623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl" event={"ID":"20914f9a-b98a-4f20-b992-e9b472393c30","Type":"ContainerStarted","Data":"b93f16c6e4f850e9e0af7418d37f635f48d53815dc253fc5588322f79797d266"}
Jul 07 20:02:18.864962 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:18.864939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2" event={"ID":"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0","Type":"ContainerStarted","Data":"162d6333cbbffe6b1c0d1bf923caeb2324ad2d7d964e6939bf705be79079abf2"}
Jul 07 20:02:22.259093 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.258986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df479756f-rz5h9"]
Jul 07 20:02:22.268167 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:22.267930    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfdb643_9e9e_46eb_ab0e_49df2c723e39.slice/crio-9958b28ee959544eff3de27c1f89a802c622e8303281ea9a601799407378e434 WatchSource:0}: Error finding container 9958b28ee959544eff3de27c1f89a802c622e8303281ea9a601799407378e434: Status 404 returned error can't find the container with id 9958b28ee959544eff3de27c1f89a802c622e8303281ea9a601799407378e434
Jul 07 20:02:22.885134 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.885094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kfsv" event={"ID":"0d06f8fd-5135-4622-ac72-214644d5e7b1","Type":"ContainerStarted","Data":"f78e574226eed9a18db7652639786ee22ab93509376a8f08a682018016a84f24"}
Jul 07 20:02:22.885320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.885191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kfsv" event={"ID":"0d06f8fd-5135-4622-ac72-214644d5e7b1","Type":"ContainerStarted","Data":"a2559756308c290a2301a9f684c8070a7467f0375ea4498ccec4d64b403ef167"}
Jul 07 20:02:22.888881 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.888848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df479756f-rz5h9" event={"ID":"4dfdb643-9e9e-46eb-ab0e-49df2c723e39","Type":"ContainerStarted","Data":"8f8dfb120cd3e9eb395e655ee0051d155bfa9cfb6eb0a37d7cddfea8ddcb5298"}
Jul 07 20:02:22.889026 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.888903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df479756f-rz5h9" event={"ID":"4dfdb643-9e9e-46eb-ab0e-49df2c723e39","Type":"ContainerStarted","Data":"9958b28ee959544eff3de27c1f89a802c622e8303281ea9a601799407378e434"}
Jul 07 20:02:22.889470 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.889450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:22.892650 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.892622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ggpz" event={"ID":"0418395f-e7d5-450f-8623-902b9b3bddb0","Type":"ContainerStarted","Data":"8b47571171a85ec24d64c27fd584376caebc9b02dcca87bf661383188e405919"}
Jul 07 20:02:22.893157 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.893133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:02:22.896391 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.895975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ss8j7" event={"ID":"31f67891-abed-4ca5-b2d1-1c4a7e3b5516","Type":"ContainerStarted","Data":"115708b185962edee11913ba415a0ce186ec82da7e1d82fccbc49b4f930203f8"}
Jul 07 20:02:22.912890 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.912377    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6kfsv" podStartSLOduration=67.60379068 podStartE2EDuration="1m13.912358171s" totalImagesPullingTime="6.308567491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:22.911072425 +0000 UTC m=+73.751569330" watchObservedRunningTime="2026-07-07 20:02:22.912358171 +0000 UTC m=+73.752855064"
Jul 07 20:02:22.939981 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.939923    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df479756f-rz5h9" podStartSLOduration=4.939902786 podStartE2EDuration="4.939902786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:02:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:22.939747433 +0000 UTC m=+73.780244343" watchObservedRunningTime="2026-07-07 20:02:22.939902786 +0000 UTC m=+73.780399683"
Jul 07 20:02:22.959258 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:22.958959    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5ggpz" podStartSLOduration=67.612078438 podStartE2EDuration="1m13.958937342s" totalImagesPullingTime="6.346858904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:22.957755061 +0000 UTC m=+73.798251940" watchObservedRunningTime="2026-07-07 20:02:22.958937342 +0000 UTC m=+73.799434221"
Jul 07 20:02:26.911285 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.911188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2" event={"ID":"87ce61f6-29ee-4f05-b6eb-22e2d0df88d0","Type":"ContainerStarted","Data":"92ccfe088cedc5bcdd50233acd247140194a7eabd717d63aa77a6bff99f64efa"}
Jul 07 20:02:26.911745 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.911300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:26.913476 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.913457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2"
Jul 07 20:02:26.913641 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.913622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt" event={"ID":"97023bc1-09f4-41cd-bb15-fac632b1442f","Type":"ContainerStarted","Data":"8947a449145ab68d14acdbf5dcce7faec1fe120480b1075659e72609545c554c"}
Jul 07 20:02:26.913684 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.913654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt" event={"ID":"97023bc1-09f4-41cd-bb15-fac632b1442f","Type":"ContainerStarted","Data":"fc3632af5bd2733c29a44f9e482bd1ee244297f4b2fda8b611357e21f438303d"}
Jul 07 20:02:26.913684 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.913676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt" event={"ID":"97023bc1-09f4-41cd-bb15-fac632b1442f","Type":"ContainerStarted","Data":"be63bc7c1377f5120bfd05aac18ece6734f3cfd6bfe2d4a8a43fc79ea240a80f"}
Jul 07 20:02:26.915059 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.915036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl" event={"ID":"20914f9a-b98a-4f20-b992-e9b472393c30","Type":"ContainerStarted","Data":"c4e215a7c0e326bb45b4b9113500822c5516c29387379d71e01c820bcb1793c5"}
Jul 07 20:02:26.933771 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.933717    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5577867494-tdqm2" podStartSLOduration=1.819439687 podStartE2EDuration="9.933701164s" totalImagesPullingTime="8.114261477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:26.932928586 +0000 UTC m=+77.773425477" watchObservedRunningTime="2026-07-07 20:02:26.933701164 +0000 UTC m=+77.774198021"
Jul 07 20:02:26.934425 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.934389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ss8j7" podStartSLOduration=71.263931548 podStartE2EDuration="1m17.934379012s" totalImagesPullingTime="6.670447464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:22.980796197 +0000 UTC m=+73.821293096" watchObservedRunningTime="2026-07-07 20:02:26.934379012 +0000 UTC m=+77.774875905"
Jul 07 20:02:26.977138 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:26.977075    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d6d75bcd-lh6tl" podStartSLOduration=1.758160459 podStartE2EDuration="9.977053878s" totalImagesPullingTime="8.218893419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:26.954190394 +0000 UTC m=+77.794687273" watchObservedRunningTime="2026-07-07 20:02:26.977053878 +0000 UTC m=+77.817550756"
Jul 07 20:02:27.004459 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:27.004403    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64fc84589-pknmt" podStartSLOduration=2.191628139 podStartE2EDuration="10.004386785s" totalImagesPullingTime="7.812758646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:27.00339347 +0000 UTC m=+77.843890359" watchObservedRunningTime="2026-07-07 20:02:27.004386785 +0000 UTC m=+77.844883662"
Jul 07 20:02:28.085869 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:28.085841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:29.497021 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.496979    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-msvc2"]
Jul 07 20:02:29.502028 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.502006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.504858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.504839    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 20:02:29.504994 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.504865    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 20:02:29.505241 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.505224    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 20:02:29.505943 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.505926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 20:02:29.506064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.505975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-24vrt\""
Jul 07 20:02:29.506138 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.505975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 20:02:29.506317 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.506305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 20:02:29.618512 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-sys\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618718 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-metrics-client-ca\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618718 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-tls\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618718 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8rn\" (UniqueName: \"kubernetes.io/projected/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-kube-api-access-nv8rn\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618718 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618718 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-accelerators-collector-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618897 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-textfile\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618897 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-root\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.618897 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.618824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-wtmp\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.719835 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-sys\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-metrics-client-ca\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-tls\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8rn\" (UniqueName: \"kubernetes.io/projected/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-kube-api-access-nv8rn\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-sys\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-accelerators-collector-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.719993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-textfile\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-root\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720040 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-wtmp\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720390 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-root\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720390 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-wtmp\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720501 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-textfile\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720689 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-accelerators-collector-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.720778 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.720685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-metrics-client-ca\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.722338 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.722307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.722474 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.722450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-node-exporter-tls\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.730456 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.730431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8rn\" (UniqueName: \"kubernetes.io/projected/6e11c08f-d26a-4c15-b9ee-e9225b3f36db-kube-api-access-nv8rn\") pod \"node-exporter-msvc2\" (UID: \"6e11c08f-d26a-4c15-b9ee-e9225b3f36db\") " pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.811437 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.811396    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msvc2"
Jul 07 20:02:29.822789 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:02:29.822763    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e11c08f_d26a_4c15_b9ee_e9225b3f36db.slice/crio-bebf609b6860d5192061932b96a3f355bdc742d9e9fcfce61fa3956f65d131cd WatchSource:0}: Error finding container bebf609b6860d5192061932b96a3f355bdc742d9e9fcfce61fa3956f65d131cd: Status 404 returned error can't find the container with id bebf609b6860d5192061932b96a3f355bdc742d9e9fcfce61fa3956f65d131cd
Jul 07 20:02:29.925071 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:29.925032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msvc2" event={"ID":"6e11c08f-d26a-4c15-b9ee-e9225b3f36db","Type":"ContainerStarted","Data":"bebf609b6860d5192061932b96a3f355bdc742d9e9fcfce61fa3956f65d131cd"}
Jul 07 20:02:31.934577 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:31.934456    2562 generic.go:356] "Generic (PLEG): container finished" podID="6e11c08f-d26a-4c15-b9ee-e9225b3f36db" containerID="5f71e71a14c43718ebd0a6126aea71971d47354aea2e75c8a49041d302a29343" exitCode=0
Jul 07 20:02:31.934577 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:31.934548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msvc2" event={"ID":"6e11c08f-d26a-4c15-b9ee-e9225b3f36db","Type":"ContainerDied","Data":"5f71e71a14c43718ebd0a6126aea71971d47354aea2e75c8a49041d302a29343"}
Jul 07 20:02:32.939814 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:32.939777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msvc2" event={"ID":"6e11c08f-d26a-4c15-b9ee-e9225b3f36db","Type":"ContainerStarted","Data":"aae3cb0fbedd0a913eab25f7656368907be9a7d38b990d666543d4241bf741eb"}
Jul 07 20:02:32.940173 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:32.939839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msvc2" event={"ID":"6e11c08f-d26a-4c15-b9ee-e9225b3f36db","Type":"ContainerStarted","Data":"fbcd2a638be193f03a48b9ce12114e4bfdcdb0e76732cedad9b02b727283ab5c"}
Jul 07 20:02:32.972710 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:32.972648    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-msvc2" podStartSLOduration=2.727815876 podStartE2EDuration="3.972628807s" totalImagesPullingTime="1.181035566s" totalInitContainerRuntime="63.777365ms" isStatefulPod=true podCreationTimestamp="2026-07-07 20:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:02:32.971990305 +0000 UTC m=+83.812487224" watchObservedRunningTime="2026-07-07 20:02:32.972628807 +0000 UTC m=+83.813125685"
Jul 07 20:02:43.112744 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.112703    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" containerName="registry" containerID="cri-o://deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5" gracePeriod=30
Jul 07 20:02:43.356269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.356242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:43.524544 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524615    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524635    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524854 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524854 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524960 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524887    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr5c9\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.524960 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524925    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted\") pod \"00bba3f8-aadd-44da-962f-dd639e35b734\" (UID: \"00bba3f8-aadd-44da-962f-dd639e35b734\") "
Jul 07 20:02:43.525194 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.524994    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 20:02:43.525285 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.525202    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 20:02:43.527284 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.527249    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9" (OuterVolumeSpecName: "kube-api-access-qr5c9") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "kube-api-access-qr5c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:02:43.527394 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.527352    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:02:43.527394 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.527374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:02:43.527516 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.527410    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:02:43.527516 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.527459    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:02:43.533620 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.533573    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "00bba3f8-aadd-44da-962f-dd639e35b734" (UID: "00bba3f8-aadd-44da-962f-dd639e35b734"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:02:43.625865 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625831    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-bound-sa-token\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.625865 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625863    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-image-registry-private-configuration\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.625865 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625873    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-registry-certificates\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.626092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625882    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-registry-tls\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.626092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625891    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bba3f8-aadd-44da-962f-dd639e35b734-trusted-ca\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.626092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625899    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr5c9\" (UniqueName: \"kubernetes.io/projected/00bba3f8-aadd-44da-962f-dd639e35b734-kube-api-access-qr5c9\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.626092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625907    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bba3f8-aadd-44da-962f-dd639e35b734-ca-trust-extracted\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.626092 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.625916    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bba3f8-aadd-44da-962f-dd639e35b734-installation-pull-secrets\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:02:43.978128 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.978034    2562 generic.go:356] "Generic (PLEG): container finished" podID="00bba3f8-aadd-44da-962f-dd639e35b734" containerID="deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5" exitCode=0
Jul 07 20:02:43.978128 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.978082    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl"
Jul 07 20:02:43.978128 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.978110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" event={"ID":"00bba3f8-aadd-44da-962f-dd639e35b734","Type":"ContainerDied","Data":"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"}
Jul 07 20:02:43.978339 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.978158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb4d9f97c-pznkl" event={"ID":"00bba3f8-aadd-44da-962f-dd639e35b734","Type":"ContainerDied","Data":"d132d1cdf29cab2b1077b8f32d144e2fa7d6a8ae29590867db14970c948fbadf"}
Jul 07 20:02:43.978339 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.978200    2562 scope.go:117] "RemoveContainer" containerID="deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"
Jul 07 20:02:43.985882 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.985864    2562 scope.go:117] "RemoveContainer" containerID="deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"
Jul 07 20:02:43.986125 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:02:43.986104    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5\": container with ID starting with deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5 not found: ID does not exist" containerID="deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"
Jul 07 20:02:43.986167 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.986133    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5"} err="failed to get container status \"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5\": rpc error: code = NotFound desc = could not find container \"deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5\": container with ID starting with deb242c269f7c182e2dd4bcfcb11cc08d248ac3849335275d843e5ee782888a5 not found: ID does not exist"
Jul 07 20:02:43.998379 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:43.998359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:02:44.000244 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:44.000217    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bb4d9f97c-pznkl"]
Jul 07 20:02:44.907483 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:44.907457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-df479756f-rz5h9"
Jul 07 20:02:45.584861 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:45.584824    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" path="/var/lib/kubelet/pods/00bba3f8-aadd-44da-962f-dd639e35b734/volumes"
Jul 07 20:02:54.905959 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:02:54.905919    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5ggpz"
Jul 07 20:06:09.476617 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:09.476573    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 20:06:57.524240 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.524203    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"]
Jul 07 20:06:57.524712 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.524473    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" containerName="registry"
Jul 07 20:06:57.524712 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.524487    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" containerName="registry"
Jul 07 20:06:57.524712 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.524537    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00bba3f8-aadd-44da-962f-dd639e35b734" containerName="registry"
Jul 07 20:06:57.527402 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.527383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.530460 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.530428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 20:06:57.532186 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.532136    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 20:06:57.532321 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.532305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 20:06:57.532389 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.532318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zjd5h\""
Jul 07 20:06:57.532511 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.532494    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 20:06:57.552083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.552052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"]
Jul 07 20:06:57.598090 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.598057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8mq\" (UniqueName: \"kubernetes.io/projected/8ea441a9-1241-456f-bb0e-3922683c34d9-kube-api-access-2g8mq\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.598250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.598112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-tmp\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.598250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.598200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.598250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.598232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-manifests\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.598371 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.598255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699236 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699236 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-manifests\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699482 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699482 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8mq\" (UniqueName: \"kubernetes.io/projected/8ea441a9-1241-456f-bb0e-3922683c34d9-kube-api-access-2g8mq\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699482 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-tmp\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.699773 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.699739    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-manifests\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.701694 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.701666    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea441a9-1241-456f-bb0e-3922683c34d9-tmp\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.701797 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.701747    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.701797 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.701780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ea441a9-1241-456f-bb0e-3922683c34d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.713938 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.713905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8mq\" (UniqueName: \"kubernetes.io/projected/8ea441a9-1241-456f-bb0e-3922683c34d9-kube-api-access-2g8mq\") pod \"opendatahub-operator-controller-manager-659495cbcb-p46hb\" (UID: \"8ea441a9-1241-456f-bb0e-3922683c34d9\") " pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.842310 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.842212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:06:57.979294 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.979181    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"]
Jul 07 20:06:57.981763 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:06:57.981731    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea441a9_1241_456f_bb0e_3922683c34d9.slice/crio-3751919a5927c3fcc2ff7ea399c7669e605b9acea39bfe8c004a3c4dd52cd80d WatchSource:0}: Error finding container 3751919a5927c3fcc2ff7ea399c7669e605b9acea39bfe8c004a3c4dd52cd80d: Status 404 returned error can't find the container with id 3751919a5927c3fcc2ff7ea399c7669e605b9acea39bfe8c004a3c4dd52cd80d
Jul 07 20:06:57.983537 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:57.983519    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 20:06:58.792681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:06:58.792626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb" event={"ID":"8ea441a9-1241-456f-bb0e-3922683c34d9","Type":"ContainerStarted","Data":"3751919a5927c3fcc2ff7ea399c7669e605b9acea39bfe8c004a3c4dd52cd80d"}
Jul 07 20:07:01.806213 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:01.806169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb" event={"ID":"8ea441a9-1241-456f-bb0e-3922683c34d9","Type":"ContainerStarted","Data":"b2c54969e6c92e3221a6b9e716c16f5f82f1f726e3d81ea0deabe1d05514b804"}
Jul 07 20:07:02.811173 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:02.811139    2562 generic.go:356] "Generic (PLEG): container finished" podID="8ea441a9-1241-456f-bb0e-3922683c34d9" containerID="b2c54969e6c92e3221a6b9e716c16f5f82f1f726e3d81ea0deabe1d05514b804" exitCode=0
Jul 07 20:07:02.811572 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:02.811219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb" event={"ID":"8ea441a9-1241-456f-bb0e-3922683c34d9","Type":"ContainerDied","Data":"b2c54969e6c92e3221a6b9e716c16f5f82f1f726e3d81ea0deabe1d05514b804"}
Jul 07 20:07:03.816962 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:03.816924    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb" event={"ID":"8ea441a9-1241-456f-bb0e-3922683c34d9","Type":"ContainerStarted","Data":"22d2666c00e858d95eff53dc89684989bee6c3a1984450754b0802986a303700"}
Jul 07 20:07:03.817347 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:03.817080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:07:03.845017 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:03.844960    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb" podStartSLOduration=2.137668989 podStartE2EDuration="6.844944637s" totalImagesPullingTime="3.639188994s" totalInitContainerRuntime="1.068086654s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:06:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:03.843265286 +0000 UTC m=+354.683762182" watchObservedRunningTime="2026-07-07 20:07:03.844944637 +0000 UTC m=+354.685441516"
Jul 07 20:07:14.823618 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:14.823552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-659495cbcb-p46hb"
Jul 07 20:07:17.407045 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.407007    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"]
Jul 07 20:07:17.422564 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.422530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.426225 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.426193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"]
Jul 07 20:07:17.426526 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.426508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 20:07:17.427380 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.427361    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 20:07:17.432402 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.432380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wqmc7\""
Jul 07 20:07:17.432507 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.432464    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 20:07:17.432902 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.432878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 20:07:17.555655 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.555620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58eb782-8c52-473e-a0f1-1910f832d61f-tls-certs\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.555821 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.555670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tp9m\" (UniqueName: \"kubernetes.io/projected/e58eb782-8c52-473e-a0f1-1910f832d61f-kube-api-access-2tp9m\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.555821 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.555697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58eb782-8c52-473e-a0f1-1910f832d61f-tmp\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.651006 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.650967    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kdgsf"]
Jul 07 20:07:17.654242 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.654225    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.656709 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.656681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58eb782-8c52-473e-a0f1-1910f832d61f-tmp\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.656848 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.656761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58eb782-8c52-473e-a0f1-1910f832d61f-tls-certs\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.656848 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.656795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tp9m\" (UniqueName: \"kubernetes.io/projected/e58eb782-8c52-473e-a0f1-1910f832d61f-kube-api-access-2tp9m\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.658978 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.658911    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58eb782-8c52-473e-a0f1-1910f832d61f-tmp\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.659090 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.659075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58eb782-8c52-473e-a0f1-1910f832d61f-tls-certs\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.659464 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.659447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 20:07:17.663497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.663475    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fbcjv\""
Jul 07 20:07:17.670560 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.670528    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kdgsf"]
Jul 07 20:07:17.675858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.675835    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tp9m\" (UniqueName: \"kubernetes.io/projected/e58eb782-8c52-473e-a0f1-1910f832d61f-kube-api-access-2tp9m\") pod \"kube-auth-proxy-68f4c445fc-b5t6b\" (UID: \"e58eb782-8c52-473e-a0f1-1910f832d61f\") " pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.734722 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.734693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"
Jul 07 20:07:17.757323 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.757288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-cert\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.757484 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.757363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zls4z\" (UniqueName: \"kubernetes.io/projected/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-kube-api-access-zls4z\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.857976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.857947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-cert\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.858134 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.857995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zls4z\" (UniqueName: \"kubernetes.io/projected/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-kube-api-access-zls4z\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.860364 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.860340    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-cert\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.876151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.876115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zls4z\" (UniqueName: \"kubernetes.io/projected/9555ccd4-5ce8-4084-ada7-5073bbaf1b69-kube-api-access-zls4z\") pod \"odh-model-controller-7998c67dc4-kdgsf\" (UID: \"9555ccd4-5ce8-4084-ada7-5073bbaf1b69\") " pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:17.890643 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.890614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b"]
Jul 07 20:07:17.892804 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:07:17.892767    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58eb782_8c52_473e_a0f1_1910f832d61f.slice/crio-c30b72beb4e67a0bacd93e6ba9e56615dcf99b73065cbe7076a7c853cadb13b0 WatchSource:0}: Error finding container c30b72beb4e67a0bacd93e6ba9e56615dcf99b73065cbe7076a7c853cadb13b0: Status 404 returned error can't find the container with id c30b72beb4e67a0bacd93e6ba9e56615dcf99b73065cbe7076a7c853cadb13b0
Jul 07 20:07:17.972821 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:17.972729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:18.132796 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.132637    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kdgsf"]
Jul 07 20:07:18.135201 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:07:18.135177    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9555ccd4_5ce8_4084_ada7_5073bbaf1b69.slice/crio-f687d520f1b6d95f01661e8305a3b395232cd9d110a612c35a80e41855ff1744 WatchSource:0}: Error finding container f687d520f1b6d95f01661e8305a3b395232cd9d110a612c35a80e41855ff1744: Status 404 returned error can't find the container with id f687d520f1b6d95f01661e8305a3b395232cd9d110a612c35a80e41855ff1744
Jul 07 20:07:18.875826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.875775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf" event={"ID":"9555ccd4-5ce8-4084-ada7-5073bbaf1b69","Type":"ContainerStarted","Data":"f687d520f1b6d95f01661e8305a3b395232cd9d110a612c35a80e41855ff1744"}
Jul 07 20:07:18.877251 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.877229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b" event={"ID":"e58eb782-8c52-473e-a0f1-1910f832d61f","Type":"ContainerStarted","Data":"c30b72beb4e67a0bacd93e6ba9e56615dcf99b73065cbe7076a7c853cadb13b0"}
Jul 07 20:07:18.970479 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.970443    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2rcx"]
Jul 07 20:07:18.973825 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.973787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:18.978209 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.978183    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 20:07:18.993712 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:18.993680    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2rcx"]
Jul 07 20:07:19.066518 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.066408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5400ae9-784b-47e3-ae18-b3a09c756d38-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.066518 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.066503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldj87\" (UniqueName: \"kubernetes.io/projected/f5400ae9-784b-47e3-ae18-b3a09c756d38-kube-api-access-ldj87\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.162431 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.162353    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:19.165558 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.165537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167285 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5400ae9-784b-47e3-ae18-b3a09c756d38-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.167417 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167514 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167723 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167838 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167838 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.167838 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5g2\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldj87\" (UniqueName: \"kubernetes.io/projected/f5400ae9-784b-47e3-ae18-b3a09c756d38-kube-api-access-ldj87\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.167892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.168382    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.168722    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g4h5k\""
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.168931    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 20:07:19.169165 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.168954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 20:07:19.170185 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.169653    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 20:07:19.170820 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.170791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5400ae9-784b-47e3-ae18-b3a09c756d38-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.183676 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.183565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldj87\" (UniqueName: \"kubernetes.io/projected/f5400ae9-784b-47e3-ae18-b3a09c756d38-kube-api-access-ldj87\") pod \"model-serving-api-54d89bd5fc-t2rcx\" (UID: \"f5400ae9-784b-47e3-ae18-b3a09c756d38\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.184211 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.184186    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:19.269078 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269078 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5g2\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.269320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.269282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.270302 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.270219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.272247 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.272203    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.272365 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.272251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.272365 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.272260    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.272466 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.272441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.279787 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.279749    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5g2\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.279942 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.279793    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token\") pod \"istiod-openshift-gateway-7574459656-j5g7s\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.287924 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.287662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:19.458532 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.458399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2rcx"]
Jul 07 20:07:19.461544 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:07:19.461502    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5400ae9_784b_47e3_ae18_b3a09c756d38.slice/crio-c6669e7678b23ba796c748b6a037fe2f539311e3e44ce22ab14eafa06a8f33fe WatchSource:0}: Error finding container c6669e7678b23ba796c748b6a037fe2f539311e3e44ce22ab14eafa06a8f33fe: Status 404 returned error can't find the container with id c6669e7678b23ba796c748b6a037fe2f539311e3e44ce22ab14eafa06a8f33fe
Jul 07 20:07:19.494547 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.494504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:19.663103 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.663064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:19.666702 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:07:19.666661    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d68ed3_e400_49e3_8757_63ca690e0e58.slice/crio-d1dc49ff25bd7dc573211c9caef4468a29f4aa41e754e7421eb9c77a9ec90316 WatchSource:0}: Error finding container d1dc49ff25bd7dc573211c9caef4468a29f4aa41e754e7421eb9c77a9ec90316: Status 404 returned error can't find the container with id d1dc49ff25bd7dc573211c9caef4468a29f4aa41e754e7421eb9c77a9ec90316
Jul 07 20:07:19.883845 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.883759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" event={"ID":"d5d68ed3-e400-49e3-8757-63ca690e0e58","Type":"ContainerStarted","Data":"d1dc49ff25bd7dc573211c9caef4468a29f4aa41e754e7421eb9c77a9ec90316"}
Jul 07 20:07:19.885603 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:19.885551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx" event={"ID":"f5400ae9-784b-47e3-ae18-b3a09c756d38","Type":"ContainerStarted","Data":"c6669e7678b23ba796c748b6a037fe2f539311e3e44ce22ab14eafa06a8f33fe"}
Jul 07 20:07:24.322867 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.322829    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 20:07:24.323169 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.322917    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 20:07:24.918021 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.917984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx" event={"ID":"f5400ae9-784b-47e3-ae18-b3a09c756d38","Type":"ContainerStarted","Data":"7204bb177feee49b5c3e184da07295f9b09e67574d2dcb18da373dacb144e3da"}
Jul 07 20:07:24.918238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.918068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:07:24.919738 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.919711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf" event={"ID":"9555ccd4-5ce8-4084-ada7-5073bbaf1b69","Type":"ContainerStarted","Data":"50774efc2ab5e32ab1530dfb91ea541bb7f8ca4c14ab60b5ef9f8b2ab43ac759"}
Jul 07 20:07:24.919884 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.919840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:24.921140 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.921118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b" event={"ID":"e58eb782-8c52-473e-a0f1-1910f832d61f","Type":"ContainerStarted","Data":"ca5718e633651602f3a494695ce1cd7697ec381b4ad5f51b7a7ce897cd8bef95"}
Jul 07 20:07:24.922806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.922787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" event={"ID":"d5d68ed3-e400-49e3-8757-63ca690e0e58","Type":"ContainerStarted","Data":"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"}
Jul 07 20:07:24.922920 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.922910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:24.936054 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.935999    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx" podStartSLOduration=2.076123334 podStartE2EDuration="6.935980682s" totalImagesPullingTime="4.859857348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:24.935691399 +0000 UTC m=+375.776188300" watchObservedRunningTime="2026-07-07 20:07:24.935980682 +0000 UTC m=+375.776477562"
Jul 07 20:07:24.953964 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.953909    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf" podStartSLOduration=1.770825138 podStartE2EDuration="7.953891428s" totalImagesPullingTime="6.18306629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:24.952759544 +0000 UTC m=+375.793256449" watchObservedRunningTime="2026-07-07 20:07:24.953891428 +0000 UTC m=+375.794388305"
Jul 07 20:07:24.969877 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.969814    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68f4c445fc-b5t6b" podStartSLOduration=1.544564791 podStartE2EDuration="7.9697942s" totalImagesPullingTime="6.425229409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:24.969400783 +0000 UTC m=+375.809897655" watchObservedRunningTime="2026-07-07 20:07:24.9697942 +0000 UTC m=+375.810291079"
Jul 07 20:07:24.994678 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:24.994602    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" podStartSLOduration=1.3407862179999999 podStartE2EDuration="5.994565732s" totalImagesPullingTime="4.653779514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:24.992236217 +0000 UTC m=+375.832733113" watchObservedRunningTime="2026-07-07 20:07:24.994565732 +0000 UTC m=+375.835062619"
Jul 07 20:07:25.928444 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:25.928416    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:27.952441 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:27.952406    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"]
Jul 07 20:07:27.955806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:27.955788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:27.970126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:27.970080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"]
Jul 07 20:07:28.045423 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045423 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045686 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3079440c-3302-42e1-ac04-71a9a57f9d01-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045686 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045686 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045686 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.045686 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.045572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdb9\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-kube-api-access-ftdb9\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.145953 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.145924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.145953 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.145959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.146203 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.145983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdb9\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-kube-api-access-ftdb9\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.146203 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.146013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.146203 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.146186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.146332 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.146260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3079440c-3302-42e1-ac04-71a9a57f9d01-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.146332 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.146299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.147080 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.147047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.148301 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.148268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.148484 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.148466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.148523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.148465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.148523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.148468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3079440c-3302-42e1-ac04-71a9a57f9d01-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.158844 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.158815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.159765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.159740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdb9\" (UniqueName: \"kubernetes.io/projected/3079440c-3302-42e1-ac04-71a9a57f9d01-kube-api-access-ftdb9\") pod \"istiod-openshift-gateway-94bb8fbfd-nkvzc\" (UID: \"3079440c-3302-42e1-ac04-71a9a57f9d01\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.264736 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.264701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.405077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.405051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"]
Jul 07 20:07:28.407365 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:07:28.407337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3079440c_3302_42e1_ac04_71a9a57f9d01.slice/crio-f275e6ef76eb036b722c514d96e66b9a741a34fc21290cf6acc4bc3589de9f5a WatchSource:0}: Error finding container f275e6ef76eb036b722c514d96e66b9a741a34fc21290cf6acc4bc3589de9f5a: Status 404 returned error can't find the container with id f275e6ef76eb036b722c514d96e66b9a741a34fc21290cf6acc4bc3589de9f5a
Jul 07 20:07:28.410393 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.410361    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 20:07:28.410497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.410428    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 20:07:28.942207 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.942165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc" event={"ID":"3079440c-3302-42e1-ac04-71a9a57f9d01","Type":"ContainerStarted","Data":"2971d29dcae476529b389b0a6bb09f99118b01884033504021ff5218eacbf85b"}
Jul 07 20:07:28.942417 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.942236    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:28.942417 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.942256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc" event={"ID":"3079440c-3302-42e1-ac04-71a9a57f9d01","Type":"ContainerStarted","Data":"f275e6ef76eb036b722c514d96e66b9a741a34fc21290cf6acc4bc3589de9f5a"}
Jul 07 20:07:28.972760 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:28.972692    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc" podStartSLOduration=1.972668555 podStartE2EDuration="1.972668555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:07:28.970528985 +0000 UTC m=+379.811025884" watchObservedRunningTime="2026-07-07 20:07:28.972668555 +0000 UTC m=+379.813165435"
Jul 07 20:07:29.948731 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:29.948696    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nkvzc"
Jul 07 20:07:30.051679 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.051647    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:30.052126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.051875    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" podUID="d5d68ed3-e400-49e3-8757-63ca690e0e58" containerName="discovery" containerID="cri-o://2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa" gracePeriod=30
Jul 07 20:07:30.298347 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.298321    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:30.365521 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.365479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.365521 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.365526    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.365784 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.365556    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.365958 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.365603    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.366083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.365980    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.366083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.366061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv5g2\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.366262 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.366111    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts\") pod \"d5d68ed3-e400-49e3-8757-63ca690e0e58\" (UID: \"d5d68ed3-e400-49e3-8757-63ca690e0e58\") "
Jul 07 20:07:30.366677 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.366646    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 20:07:30.369301 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.369266    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:07:30.369406 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.369328    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:07:30.369503 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.369484    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs" (OuterVolumeSpecName: "local-certs") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:07:30.369679 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.369652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2" (OuterVolumeSpecName: "kube-api-access-nv5g2") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "kube-api-access-nv5g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:07:30.369753 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.369674    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:07:30.370051 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.370029    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts" (OuterVolumeSpecName: "cacerts") pod "d5d68ed3-e400-49e3-8757-63ca690e0e58" (UID: "d5d68ed3-e400-49e3-8757-63ca690e0e58"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:07:30.467474 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467437    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-token\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467474 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467468    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5d68ed3-e400-49e3-8757-63ca690e0e58-local-certs\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467474 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467477    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-ca-configmap\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467488    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv5g2\" (UniqueName: \"kubernetes.io/projected/d5d68ed3-e400-49e3-8757-63ca690e0e58-kube-api-access-nv5g2\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467497    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-cacerts\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467505    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-kubeconfig\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.467751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.467514    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5d68ed3-e400-49e3-8757-63ca690e0e58-istio-csr-dns-cert\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:07:30.951954 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.951920    2562 generic.go:356] "Generic (PLEG): container finished" podID="d5d68ed3-e400-49e3-8757-63ca690e0e58" containerID="2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa" exitCode=0
Jul 07 20:07:30.952224 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.951983    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"
Jul 07 20:07:30.952224 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.952018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" event={"ID":"d5d68ed3-e400-49e3-8757-63ca690e0e58","Type":"ContainerDied","Data":"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"}
Jul 07 20:07:30.952224 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.952084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s" event={"ID":"d5d68ed3-e400-49e3-8757-63ca690e0e58","Type":"ContainerDied","Data":"d1dc49ff25bd7dc573211c9caef4468a29f4aa41e754e7421eb9c77a9ec90316"}
Jul 07 20:07:30.952224 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.952114    2562 scope.go:117] "RemoveContainer" containerID="2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"
Jul 07 20:07:30.960829 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.960804    2562 scope.go:117] "RemoveContainer" containerID="2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"
Jul 07 20:07:30.961118 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:07:30.961100    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa\": container with ID starting with 2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa not found: ID does not exist" containerID="2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"
Jul 07 20:07:30.961170 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.961128    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa"} err="failed to get container status \"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa\": rpc error: code = NotFound desc = could not find container \"2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa\": container with ID starting with 2740a475385d7a11f7e7942cf235cc3116a318b9541817c14bdbabd9473c98aa not found: ID does not exist"
Jul 07 20:07:30.981552 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.981512    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:30.984042 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:30.984015    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j5g7s"]
Jul 07 20:07:31.585110 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:31.585079    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d68ed3-e400-49e3-8757-63ca690e0e58" path="/var/lib/kubelet/pods/d5d68ed3-e400-49e3-8757-63ca690e0e58/volumes"
Jul 07 20:07:35.928969 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:35.928935    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kdgsf"
Jul 07 20:07:35.930989 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:07:35.930966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-t2rcx"
Jul 07 20:08:18.686144 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.686107    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:18.686605 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.686403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d68ed3-e400-49e3-8757-63ca690e0e58" containerName="discovery"
Jul 07 20:08:18.686605 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.686415    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d68ed3-e400-49e3-8757-63ca690e0e58" containerName="discovery"
Jul 07 20:08:18.686605 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.686461    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d68ed3-e400-49e3-8757-63ca690e0e58" containerName="discovery"
Jul 07 20:08:18.690522 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.690500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:18.697890 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.697868    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 20:08:18.697890 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.697878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 20:08:18.698083 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.697868    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5z5v5\""
Jul 07 20:08:18.707890 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.707863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:18.862902 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.862860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v9r5\" (UniqueName: \"kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5\") pod \"kuadrant-operator-catalog-xh6rd\" (UID: \"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:18.963477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.963376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v9r5\" (UniqueName: \"kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5\") pod \"kuadrant-operator-catalog-xh6rd\" (UID: \"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:18.973630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:18.973580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v9r5\" (UniqueName: \"kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5\") pod \"kuadrant-operator-catalog-xh6rd\" (UID: \"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:19.000575 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.000542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:19.017883 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.017855    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:19.138393 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.138273    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:19.141099 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:08:19.141067    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed5a60b_9dc7_4389_9c41_6428aa22a0b8.slice/crio-43ce87b3f47a5c6c9ad06dbd36816d2daea39204f614f981974ce97dceb8eb0f WatchSource:0}: Error finding container 43ce87b3f47a5c6c9ad06dbd36816d2daea39204f614f981974ce97dceb8eb0f: Status 404 returned error can't find the container with id 43ce87b3f47a5c6c9ad06dbd36816d2daea39204f614f981974ce97dceb8eb0f
Jul 07 20:08:19.228014 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.227933    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzszn"]
Jul 07 20:08:19.232024 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.232007    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:19.242451 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.242425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzszn"]
Jul 07 20:08:19.365972 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.365925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bbh\" (UniqueName: \"kubernetes.io/projected/97f0ea9d-3b07-4d67-9bb8-bca7db81349b-kube-api-access-j4bbh\") pod \"kuadrant-operator-catalog-kzszn\" (UID: \"97f0ea9d-3b07-4d67-9bb8-bca7db81349b\") " pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:19.467155 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.467117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bbh\" (UniqueName: \"kubernetes.io/projected/97f0ea9d-3b07-4d67-9bb8-bca7db81349b-kube-api-access-j4bbh\") pod \"kuadrant-operator-catalog-kzszn\" (UID: \"97f0ea9d-3b07-4d67-9bb8-bca7db81349b\") " pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:19.476845 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.476817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bbh\" (UniqueName: \"kubernetes.io/projected/97f0ea9d-3b07-4d67-9bb8-bca7db81349b-kube-api-access-j4bbh\") pod \"kuadrant-operator-catalog-kzszn\" (UID: \"97f0ea9d-3b07-4d67-9bb8-bca7db81349b\") " pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:19.540851 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.540808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:19.670744 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:19.670709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzszn"]
Jul 07 20:08:19.673888 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:08:19.673857    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f0ea9d_3b07_4d67_9bb8_bca7db81349b.slice/crio-689cc2ce1ff8a72debc8963b26ed2e572e7c4dc4f5d58a0f0f6f13e7535aafa0 WatchSource:0}: Error finding container 689cc2ce1ff8a72debc8963b26ed2e572e7c4dc4f5d58a0f0f6f13e7535aafa0: Status 404 returned error can't find the container with id 689cc2ce1ff8a72debc8963b26ed2e572e7c4dc4f5d58a0f0f6f13e7535aafa0
Jul 07 20:08:20.149251 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:20.149215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzszn" event={"ID":"97f0ea9d-3b07-4d67-9bb8-bca7db81349b","Type":"ContainerStarted","Data":"689cc2ce1ff8a72debc8963b26ed2e572e7c4dc4f5d58a0f0f6f13e7535aafa0"}
Jul 07 20:08:20.150485 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:20.150455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" event={"ID":"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8","Type":"ContainerStarted","Data":"43ce87b3f47a5c6c9ad06dbd36816d2daea39204f614f981974ce97dceb8eb0f"}
Jul 07 20:08:22.160711 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.160673    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" event={"ID":"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8","Type":"ContainerStarted","Data":"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"}
Jul 07 20:08:22.161167 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.160732    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" podUID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" containerName="registry-server" containerID="cri-o://8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad" gracePeriod=2
Jul 07 20:08:22.162183 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.162163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzszn" event={"ID":"97f0ea9d-3b07-4d67-9bb8-bca7db81349b","Type":"ContainerStarted","Data":"ec23b7dcf09b5c6ded99b9318d1fdc7d13ad4f15218c643fc6adcb3d88a8f3b6"}
Jul 07 20:08:22.177963 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.177914    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" podStartSLOduration=1.608520687 podStartE2EDuration="4.177895047s" totalImagesPullingTime="2.56937436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:08:22.177129451 +0000 UTC m=+433.017626350" watchObservedRunningTime="2026-07-07 20:08:22.177895047 +0000 UTC m=+433.018391925"
Jul 07 20:08:22.194841 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.194789    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kzszn" podStartSLOduration=1.15486146 podStartE2EDuration="3.194775565s" totalImagesPullingTime="2.039914105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:08:22.193490158 +0000 UTC m=+433.033987027" watchObservedRunningTime="2026-07-07 20:08:22.194775565 +0000 UTC m=+433.035272493"
Jul 07 20:08:22.402077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.402054    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:22.489383 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.489288    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v9r5\" (UniqueName: \"kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5\") pod \"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8\" (UID: \"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8\") "
Jul 07 20:08:22.491408 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.491383    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5" (OuterVolumeSpecName: "kube-api-access-4v9r5") pod "0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" (UID: "0ed5a60b-9dc7-4389-9c41-6428aa22a0b8"). InnerVolumeSpecName "kube-api-access-4v9r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:08:22.594039 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:22.590429    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v9r5\" (UniqueName: \"kubernetes.io/projected/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8-kube-api-access-4v9r5\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:08:23.168137 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.168103    2562 generic.go:356] "Generic (PLEG): container finished" podID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" containerID="8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad" exitCode=0
Jul 07 20:08:23.168571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.168160    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd"
Jul 07 20:08:23.168571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.168195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" event={"ID":"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8","Type":"ContainerDied","Data":"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"}
Jul 07 20:08:23.168571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.168265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh6rd" event={"ID":"0ed5a60b-9dc7-4389-9c41-6428aa22a0b8","Type":"ContainerDied","Data":"43ce87b3f47a5c6c9ad06dbd36816d2daea39204f614f981974ce97dceb8eb0f"}
Jul 07 20:08:23.168571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.168285    2562 scope.go:117] "RemoveContainer" containerID="8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"
Jul 07 20:08:23.176931 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.176915    2562 scope.go:117] "RemoveContainer" containerID="8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"
Jul 07 20:08:23.177192 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:08:23.177174    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad\": container with ID starting with 8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad not found: ID does not exist" containerID="8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"
Jul 07 20:08:23.177235 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.177200    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad"} err="failed to get container status \"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad\": rpc error: code = NotFound desc = could not find container \"8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad\": container with ID starting with 8364b71ebbfb72e035b7d496806da3f9ec6495ec474b8519be8d330e34439dad not found: ID does not exist"
Jul 07 20:08:23.190948 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.190925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:23.194559 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.194537    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh6rd"]
Jul 07 20:08:23.585052 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:23.585019    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" path="/var/lib/kubelet/pods/0ed5a60b-9dc7-4389-9c41-6428aa22a0b8/volumes"
Jul 07 20:08:29.541497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:29.541459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:29.542041 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:29.541536    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:29.564254 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:29.564215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:30.216374 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:30.216349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kzszn"
Jul 07 20:08:50.096693 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.096645    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"]
Jul 07 20:08:50.097137 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.096915    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" containerName="registry-server"
Jul 07 20:08:50.097137 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.096925    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" containerName="registry-server"
Jul 07 20:08:50.097137 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.096985    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed5a60b-9dc7-4389-9c41-6428aa22a0b8" containerName="registry-server"
Jul 07 20:08:50.099785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.099769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:50.102373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.102354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vvksh\""
Jul 07 20:08:50.112387 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.112366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"]
Jul 07 20:08:50.204693 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.204654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swp4v\" (UniqueName: \"kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v\") pod \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" (UID: \"4d877d35-2769-46c9-a27e-0fb64c2df0f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:50.305539 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.305502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swp4v\" (UniqueName: \"kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v\") pod \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" (UID: \"4d877d35-2769-46c9-a27e-0fb64c2df0f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:50.321301 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.321267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swp4v\" (UniqueName: \"kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v\") pod \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" (UID: \"4d877d35-2769-46c9-a27e-0fb64c2df0f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:50.410265 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.410178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:50.542116 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:50.542078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"]
Jul 07 20:08:50.544655 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:08:50.544625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d877d35_2769_46c9_a27e_0fb64c2df0f7.slice/crio-fe80f35139a44c6dc1f7ebc10e1a2d39eb1933f4a47538106c6b4d4e1fd69ba8 WatchSource:0}: Error finding container fe80f35139a44c6dc1f7ebc10e1a2d39eb1933f4a47538106c6b4d4e1fd69ba8: Status 404 returned error can't find the container with id fe80f35139a44c6dc1f7ebc10e1a2d39eb1933f4a47538106c6b4d4e1fd69ba8
Jul 07 20:08:51.280796 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:51.280753    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb" event={"ID":"4d877d35-2769-46c9-a27e-0fb64c2df0f7","Type":"ContainerStarted","Data":"fe80f35139a44c6dc1f7ebc10e1a2d39eb1933f4a47538106c6b4d4e1fd69ba8"}
Jul 07 20:08:53.289401 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:53.289366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb" event={"ID":"4d877d35-2769-46c9-a27e-0fb64c2df0f7","Type":"ContainerStarted","Data":"6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d"}
Jul 07 20:08:53.289854 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:53.289502    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:08:53.308868 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:53.308817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb" podStartSLOduration=1.533119965 podStartE2EDuration="3.308801126s" totalImagesPullingTime="1.775681161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:08:53.308024557 +0000 UTC m=+464.148521455" watchObservedRunningTime="2026-07-07 20:08:53.308801126 +0000 UTC m=+464.149298016"
Jul 07 20:08:57.430044 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.430007    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"]
Jul 07 20:08:57.434428 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.434409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:08:57.437750 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.437727    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vhjlb\""
Jul 07 20:08:57.438058 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.438044    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 20:08:57.460544 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.460517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"]
Jul 07 20:08:57.562373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.562337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brtb\" (UniqueName: \"kubernetes.io/projected/c020ec86-188d-48c9-84e9-02f03a941865-kube-api-access-4brtb\") pod \"dns-operator-controller-manager-864dd78c4c-6hmw4\" (UID: \"c020ec86-188d-48c9-84e9-02f03a941865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:08:57.663748 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.663714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4brtb\" (UniqueName: \"kubernetes.io/projected/c020ec86-188d-48c9-84e9-02f03a941865-kube-api-access-4brtb\") pod \"dns-operator-controller-manager-864dd78c4c-6hmw4\" (UID: \"c020ec86-188d-48c9-84e9-02f03a941865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:08:57.677698 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.677667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brtb\" (UniqueName: \"kubernetes.io/projected/c020ec86-188d-48c9-84e9-02f03a941865-kube-api-access-4brtb\") pod \"dns-operator-controller-manager-864dd78c4c-6hmw4\" (UID: \"c020ec86-188d-48c9-84e9-02f03a941865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:08:57.743976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.743895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:08:57.886580 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:57.886549    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"]
Jul 07 20:08:57.889127 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:08:57.889099    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc020ec86_188d_48c9_84e9_02f03a941865.slice/crio-d65c202319a6b2ca73ddf14c7eeca9a4969c6ce30188be81adc3e0e261ea7214 WatchSource:0}: Error finding container d65c202319a6b2ca73ddf14c7eeca9a4969c6ce30188be81adc3e0e261ea7214: Status 404 returned error can't find the container with id d65c202319a6b2ca73ddf14c7eeca9a4969c6ce30188be81adc3e0e261ea7214
Jul 07 20:08:58.309241 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:08:58.309209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4" event={"ID":"c020ec86-188d-48c9-84e9-02f03a941865","Type":"ContainerStarted","Data":"d65c202319a6b2ca73ddf14c7eeca9a4969c6ce30188be81adc3e0e261ea7214"}
Jul 07 20:09:01.328707 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:01.328655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4" event={"ID":"c020ec86-188d-48c9-84e9-02f03a941865","Type":"ContainerStarted","Data":"67939b9ca354d274f4d17d2ac7bb148bc4b26ea55c0942791433af93d627fcf8"}
Jul 07 20:09:01.329134 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:01.328845    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:09:01.353992 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:01.353938    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4" podStartSLOduration=1.521081559 podStartE2EDuration="4.353919562s" totalImagesPullingTime="2.832838003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:09:01.352901047 +0000 UTC m=+472.193397958" watchObservedRunningTime="2026-07-07 20:09:01.353919562 +0000 UTC m=+472.194416440"
Jul 07 20:09:02.050910 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.050874    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"]
Jul 07 20:09:02.054108 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.054091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.056543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.056519    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4tsr7\""
Jul 07 20:09:02.066473 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.066448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"]
Jul 07 20:09:02.203706 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.203650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.203706 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.203724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2vkv\" (UniqueName: \"kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.304788 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.304710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.304788 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.304758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2vkv\" (UniqueName: \"kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.305123 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.305099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.314510 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.314478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2vkv\" (UniqueName: \"kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.364241 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.364196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:02.500239 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:02.500199    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"]
Jul 07 20:09:02.503531 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:09:02.503494    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd23244_1d4d_4d0f_a641_ed2b99832436.slice/crio-c35e107f6dc69e5c806da4a2f31cf87f1b547e0708e97356ae9f149fae02ceb6 WatchSource:0}: Error finding container c35e107f6dc69e5c806da4a2f31cf87f1b547e0708e97356ae9f149fae02ceb6: Status 404 returned error can't find the container with id c35e107f6dc69e5c806da4a2f31cf87f1b547e0708e97356ae9f149fae02ceb6
Jul 07 20:09:03.338539 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:03.338509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5" event={"ID":"6fd23244-1d4d-4d0f-a641-ed2b99832436","Type":"ContainerStarted","Data":"c35e107f6dc69e5c806da4a2f31cf87f1b547e0708e97356ae9f149fae02ceb6"}
Jul 07 20:09:04.295724 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:04.295683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:10.373489 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:10.373450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5" event={"ID":"6fd23244-1d4d-4d0f-a641-ed2b99832436","Type":"ContainerStarted","Data":"68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01"}
Jul 07 20:09:10.373858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:10.373571    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:10.397916 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:10.397862    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5" podStartSLOduration=1.249519258 podStartE2EDuration="8.397847012s" totalImagesPullingTime="7.148327754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:09:10.396481417 +0000 UTC m=+481.236978319" watchObservedRunningTime="2026-07-07 20:09:10.397847012 +0000 UTC m=+481.238343890"
Jul 07 20:09:12.335347 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:12.335318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hmw4"
Jul 07 20:09:21.380741 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:21.380703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:22.255445 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.255408    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"]
Jul 07 20:09:22.259931 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.259914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.271065 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.271034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"]
Jul 07 20:09:22.367610 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.367549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.367793 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.367640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n4tp\" (UniqueName: \"kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.468897 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.468863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.469259 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.468910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n4tp\" (UniqueName: \"kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.469259 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.469212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.478737 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.478714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n4tp\" (UniqueName: \"kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.569245 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.569208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:22.726726 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:22.726696    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"]
Jul 07 20:09:22.729676 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:09:22.729638    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb860aa88_eef5_41d3_bf02_f9787d296d0c.slice/crio-c0b19812b0a95162020d7bd1bb462c8e391081b9ac2b51ee313442d5f8270134 WatchSource:0}: Error finding container c0b19812b0a95162020d7bd1bb462c8e391081b9ac2b51ee313442d5f8270134: Status 404 returned error can't find the container with id c0b19812b0a95162020d7bd1bb462c8e391081b9ac2b51ee313442d5f8270134
Jul 07 20:09:23.074493 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.074446    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"]
Jul 07 20:09:23.081025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.080994    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"]
Jul 07 20:09:23.089707 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.089678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"]
Jul 07 20:09:23.089888 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.089863    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" containerName="manager" containerID="cri-o://68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01" gracePeriod=2
Jul 07 20:09:23.094717 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.094690    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"]
Jul 07 20:09:23.101312 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101276    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:23.101733 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101705    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" containerName="manager"
Jul 07 20:09:23.101733 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101731    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" containerName="manager"
Jul 07 20:09:23.101894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101747    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" containerName="manager"
Jul 07 20:09:23.101894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101756    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" containerName="manager"
Jul 07 20:09:23.101894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101846    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" containerName="manager"
Jul 07 20:09:23.101894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.101856    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" containerName="manager"
Jul 07 20:09:23.104937 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.104915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.107280 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.107251    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.112064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.112040    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"]
Jul 07 20:09:23.112328 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.112302    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" containerName="manager" containerID="cri-o://6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d" gracePeriod=2
Jul 07 20:09:23.113541 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.113520    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:23.118621 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.118577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.119749 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.119029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:23.120429 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.120378    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"]
Jul 07 20:09:23.130835 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.130791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:23.158301 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.158267    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.160209 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.160173    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.277045 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.276868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.277045 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.276922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.277045 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.276962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6gl\" (UniqueName: \"kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.277045 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.276991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptp7\" (UniqueName: \"kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.337230 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.337210    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.339768 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.339738    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.341840 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.341813    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.343681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.343664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.345776 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.345751    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.347827 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.347809    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.378220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.378220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.378447 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6gl\" (UniqueName: \"kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.378447 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptp7\" (UniqueName: \"kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.378582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378560    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.378582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.378572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.387302 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.387277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6gl\" (UniqueName: \"kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6f5b\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.387407 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.387314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptp7\" (UniqueName: \"kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2msv\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.426968 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.426934    2562 generic.go:356] "Generic (PLEG): container finished" podID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" containerID="6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d" exitCode=0
Jul 07 20:09:23.427104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.426980    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.427104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.427041    2562 scope.go:117] "RemoveContainer" containerID="6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d"
Jul 07 20:09:23.428264 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.428242    2562 generic.go:356] "Generic (PLEG): container finished" podID="6fd23244-1d4d-4d0f-a641-ed2b99832436" containerID="68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01" exitCode=0
Jul 07 20:09:23.428382 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.428289    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.429340 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.429318    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.430131 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.430116    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9" container="manager"
Jul 07 20:09:23.431252 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.431223    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.433288 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.433260    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2qpz5\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2qpz5"
Jul 07 20:09:23.435175 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.435153    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4wxbb\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4wxbb"
Jul 07 20:09:23.435981 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.435965    2562 scope.go:117] "RemoveContainer" containerID="6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d"
Jul 07 20:09:23.436259 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.436238    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d\": container with ID starting with 6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d not found: ID does not exist" containerID="6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d"
Jul 07 20:09:23.436308 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.436269    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d"} err="failed to get container status \"6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d\": rpc error: code = NotFound desc = could not find container \"6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d\": container with ID starting with 6f20050014e9d53e497b45efb4533f470c387b18085d0293af9b997900ef187d not found: ID does not exist"
Jul 07 20:09:23.436308 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.436285    2562 scope.go:117] "RemoveContainer" containerID="68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01"
Jul 07 20:09:23.437328 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.437288    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:23.444104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.444085    2562 scope.go:117] "RemoveContainer" containerID="68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01"
Jul 07 20:09:23.444405 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:23.444381    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01\": container with ID starting with 68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01 not found: ID does not exist" containerID="68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01"
Jul 07 20:09:23.444476 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.444416    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01"} err="failed to get container status \"68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01\": rpc error: code = NotFound desc = could not find container \"68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01\": container with ID starting with 68433831e2bfc6f66eabf16789e12c2e5c74732d385e10aec67a0803ae831d01 not found: ID does not exist"
Jul 07 20:09:23.478807 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.478774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2vkv\" (UniqueName: \"kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv\") pod \"6fd23244-1d4d-4d0f-a641-ed2b99832436\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") "
Jul 07 20:09:23.479183 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.478838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume\") pod \"6fd23244-1d4d-4d0f-a641-ed2b99832436\" (UID: \"6fd23244-1d4d-4d0f-a641-ed2b99832436\") "
Jul 07 20:09:23.479183 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.478881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swp4v\" (UniqueName: \"kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v\") pod \"4d877d35-2769-46c9-a27e-0fb64c2df0f7\" (UID: \"4d877d35-2769-46c9-a27e-0fb64c2df0f7\") "
Jul 07 20:09:23.479392 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.479368    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6fd23244-1d4d-4d0f-a641-ed2b99832436" (UID: "6fd23244-1d4d-4d0f-a641-ed2b99832436"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:09:23.480937 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.480907    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v" (OuterVolumeSpecName: "kube-api-access-swp4v") pod "4d877d35-2769-46c9-a27e-0fb64c2df0f7" (UID: "4d877d35-2769-46c9-a27e-0fb64c2df0f7"). InnerVolumeSpecName "kube-api-access-swp4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:09:23.481035 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.480957    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv" (OuterVolumeSpecName: "kube-api-access-t2vkv") pod "6fd23244-1d4d-4d0f-a641-ed2b99832436" (UID: "6fd23244-1d4d-4d0f-a641-ed2b99832436"). InnerVolumeSpecName "kube-api-access-t2vkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:09:23.506419 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.506388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:23.512403 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.512384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:23.579806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.579578    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swp4v\" (UniqueName: \"kubernetes.io/projected/4d877d35-2769-46c9-a27e-0fb64c2df0f7-kube-api-access-swp4v\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:23.579806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.579675    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2vkv\" (UniqueName: \"kubernetes.io/projected/6fd23244-1d4d-4d0f-a641-ed2b99832436-kube-api-access-t2vkv\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:23.579806 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.579685    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23244-1d4d-4d0f-a641-ed2b99832436-extensions-socket-volume\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:23.593509 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.587634    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" path="/var/lib/kubelet/pods/4d877d35-2769-46c9-a27e-0fb64c2df0f7/volumes"
Jul 07 20:09:23.593509 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.588161    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd23244-1d4d-4d0f-a641-ed2b99832436" path="/var/lib/kubelet/pods/6fd23244-1d4d-4d0f-a641-ed2b99832436/volumes"
Jul 07 20:09:23.662510 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.662074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:23.665296 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:09:23.665268    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99095679_ee1b_466f_99be_a1b02bc2bee3.slice/crio-8dfc928cfafdd8ad98bd2379f497e741f3e798ff5e31d57c05a19415f8bbdb3e WatchSource:0}: Error finding container 8dfc928cfafdd8ad98bd2379f497e741f3e798ff5e31d57c05a19415f8bbdb3e: Status 404 returned error can't find the container with id 8dfc928cfafdd8ad98bd2379f497e741f3e798ff5e31d57c05a19415f8bbdb3e
Jul 07 20:09:23.678542 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:23.678518    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:23.681936 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:09:23.681891    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode698bb9e_d22f_418c_a62e_23546006ffe9.slice/crio-ac8420dfcc44d801fdad3c5c172fe2b1858b6cf2d9024fe36e6a564fa705d2bb WatchSource:0}: Error finding container ac8420dfcc44d801fdad3c5c172fe2b1858b6cf2d9024fe36e6a564fa705d2bb: Status 404 returned error can't find the container with id ac8420dfcc44d801fdad3c5c172fe2b1858b6cf2d9024fe36e6a564fa705d2bb
Jul 07 20:09:24.437201 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.437161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" event={"ID":"e698bb9e-d22f-418c-a62e-23546006ffe9","Type":"ContainerStarted","Data":"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"}
Jul 07 20:09:24.437407 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.437220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" event={"ID":"e698bb9e-d22f-418c-a62e-23546006ffe9","Type":"ContainerStarted","Data":"ac8420dfcc44d801fdad3c5c172fe2b1858b6cf2d9024fe36e6a564fa705d2bb"}
Jul 07 20:09:24.437407 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.437250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:24.438897 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.438844    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" containerName="manager" containerID="cri-o://0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97" gracePeriod=2
Jul 07 20:09:24.441247 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.441224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" event={"ID":"99095679-ee1b-466f-99be-a1b02bc2bee3","Type":"ContainerStarted","Data":"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"}
Jul 07 20:09:24.441349 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.441279    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:24.441349 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.441295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" event={"ID":"99095679-ee1b-466f-99be-a1b02bc2bee3","Type":"ContainerStarted","Data":"8dfc928cfafdd8ad98bd2379f497e741f3e798ff5e31d57c05a19415f8bbdb3e"}
Jul 07 20:09:24.461381 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.461327    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" podStartSLOduration=1.461309355 podStartE2EDuration="1.461309355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:09:24.46007394 +0000 UTC m=+495.300570828" watchObservedRunningTime="2026-07-07 20:09:24.461309355 +0000 UTC m=+495.301806233"
Jul 07 20:09:24.479994 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.479931    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" podStartSLOduration=1.479914609 podStartE2EDuration="1.479914609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:09:24.47976261 +0000 UTC m=+495.320259516" watchObservedRunningTime="2026-07-07 20:09:24.479914609 +0000 UTC m=+495.320411487"
Jul 07 20:09:24.680278 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.680245    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:24.682727 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:24.682702    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:24.685967 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.685945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n4tp\" (UniqueName: \"kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp\") pod \"b860aa88-eef5-41d3-bf02-f9787d296d0c\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") "
Jul 07 20:09:24.686059 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.686013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume\") pod \"b860aa88-eef5-41d3-bf02-f9787d296d0c\" (UID: \"b860aa88-eef5-41d3-bf02-f9787d296d0c\") "
Jul 07 20:09:24.686361 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.686341    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b860aa88-eef5-41d3-bf02-f9787d296d0c" (UID: "b860aa88-eef5-41d3-bf02-f9787d296d0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:09:24.688090 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.688043    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp" (OuterVolumeSpecName: "kube-api-access-8n4tp") pod "b860aa88-eef5-41d3-bf02-f9787d296d0c" (UID: "b860aa88-eef5-41d3-bf02-f9787d296d0c"). InnerVolumeSpecName "kube-api-access-8n4tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:09:24.787341 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.787302    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n4tp\" (UniqueName: \"kubernetes.io/projected/b860aa88-eef5-41d3-bf02-f9787d296d0c-kube-api-access-8n4tp\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:24.787341 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:24.787335    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b860aa88-eef5-41d3-bf02-f9787d296d0c-extensions-socket-volume\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:25.447396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.447360    2562 generic.go:356] "Generic (PLEG): container finished" podID="b860aa88-eef5-41d3-bf02-f9787d296d0c" containerID="0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97" exitCode=0
Jul 07 20:09:25.447574 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.447414    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:25.447574 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.447464    2562 scope.go:117] "RemoveContainer" containerID="0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97"
Jul 07 20:09:25.449867 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:25.449838    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:25.456273 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.456255    2562 scope.go:117] "RemoveContainer" containerID="0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97"
Jul 07 20:09:25.456551 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:25.456533    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97\": container with ID starting with 0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97 not found: ID does not exist" containerID="0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97"
Jul 07 20:09:25.456639 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.456560    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97"} err="failed to get container status \"0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97\": rpc error: code = NotFound desc = could not find container \"0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97\": container with ID starting with 0830e15329bfed2f59bd938a577e58dac55e8b8a2ffda766cc81cce1b254ea97 not found: ID does not exist"
Jul 07 20:09:25.457354 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:25.457331    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sqtx9\" is forbidden: User \"system:node:ip-10-0-134-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-113.ec2.internal' and this object" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sqtx9"
Jul 07 20:09:25.585469 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:25.585438    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b860aa88-eef5-41d3-bf02-f9787d296d0c" path="/var/lib/kubelet/pods/b860aa88-eef5-41d3-bf02-f9787d296d0c/volumes"
Jul 07 20:09:35.450676 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.450644    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:35.451065 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.450720    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:35.527170 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.527133    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:35.527341 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.527308    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" podUID="e698bb9e-d22f-418c-a62e-23546006ffe9" containerName="manager" containerID="cri-o://4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682" gracePeriod=10
Jul 07 20:09:35.766868 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.766843    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:35.867333 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:09:35.867618 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e698bb9e-d22f-418c-a62e-23546006ffe9" containerName="manager"
Jul 07 20:09:35.867679 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867627    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e698bb9e-d22f-418c-a62e-23546006ffe9" containerName="manager"
Jul 07 20:09:35.867679 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867651    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" containerName="manager"
Jul 07 20:09:35.867679 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867656    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" containerName="manager"
Jul 07 20:09:35.867767 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867702    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e698bb9e-d22f-418c-a62e-23546006ffe9" containerName="manager"
Jul 07 20:09:35.867767 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.867711    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d877d35-2769-46c9-a27e-0fb64c2df0f7" containerName="manager"
Jul 07 20:09:35.871218 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.871196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:35.877329 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.877149    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume\") pod \"e698bb9e-d22f-418c-a62e-23546006ffe9\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") "
Jul 07 20:09:35.877329 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.877185    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gptp7\" (UniqueName: \"kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7\") pod \"e698bb9e-d22f-418c-a62e-23546006ffe9\" (UID: \"e698bb9e-d22f-418c-a62e-23546006ffe9\") "
Jul 07 20:09:35.877642 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.877613    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e698bb9e-d22f-418c-a62e-23546006ffe9" (UID: "e698bb9e-d22f-418c-a62e-23546006ffe9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:09:35.879558 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.879524    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7" (OuterVolumeSpecName: "kube-api-access-gptp7") pod "e698bb9e-d22f-418c-a62e-23546006ffe9" (UID: "e698bb9e-d22f-418c-a62e-23546006ffe9"). InnerVolumeSpecName "kube-api-access-gptp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:09:35.895087 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.895050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:09:35.978768 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.978724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:35.978974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.978789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bzd\" (UniqueName: \"kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:35.978974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.978860    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e698bb9e-d22f-418c-a62e-23546006ffe9-extensions-socket-volume\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:35.978974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:35.978875    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gptp7\" (UniqueName: \"kubernetes.io/projected/e698bb9e-d22f-418c-a62e-23546006ffe9-kube-api-access-gptp7\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:36.079402 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.079362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bzd\" (UniqueName: \"kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.079615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.079532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.079916 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.079896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.089742 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.089704    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bzd\" (UniqueName: \"kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd\") pod \"kuadrant-operator-controller-manager-86878c769f-bqv8s\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.181343 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.181308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.314201 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.314162    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:09:36.317287 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:09:36.317258    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67281304_9659_4b52_b669_537a08b4473a.slice/crio-978f05b35cff3dbad54deda53070e4cb834a1e727e25fc226bd7589bf295ab2b WatchSource:0}: Error finding container 978f05b35cff3dbad54deda53070e4cb834a1e727e25fc226bd7589bf295ab2b: Status 404 returned error can't find the container with id 978f05b35cff3dbad54deda53070e4cb834a1e727e25fc226bd7589bf295ab2b
Jul 07 20:09:36.499350 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.499319    2562 generic.go:356] "Generic (PLEG): container finished" podID="e698bb9e-d22f-418c-a62e-23546006ffe9" containerID="4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682" exitCode=0
Jul 07 20:09:36.499887 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.499369    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"
Jul 07 20:09:36.499887 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.499405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" event={"ID":"e698bb9e-d22f-418c-a62e-23546006ffe9","Type":"ContainerDied","Data":"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"}
Jul 07 20:09:36.499887 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.499460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv" event={"ID":"e698bb9e-d22f-418c-a62e-23546006ffe9","Type":"ContainerDied","Data":"ac8420dfcc44d801fdad3c5c172fe2b1858b6cf2d9024fe36e6a564fa705d2bb"}
Jul 07 20:09:36.499887 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.499489    2562 scope.go:117] "RemoveContainer" containerID="4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"
Jul 07 20:09:36.501302 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.501279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" event={"ID":"67281304-9659-4b52-b669-537a08b4473a","Type":"ContainerStarted","Data":"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"}
Jul 07 20:09:36.501415 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.501332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" event={"ID":"67281304-9659-4b52-b669-537a08b4473a","Type":"ContainerStarted","Data":"978f05b35cff3dbad54deda53070e4cb834a1e727e25fc226bd7589bf295ab2b"}
Jul 07 20:09:36.501415 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.501360    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:36.508647 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.508624    2562 scope.go:117] "RemoveContainer" containerID="4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"
Jul 07 20:09:36.508896 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:36.508879    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682\": container with ID starting with 4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682 not found: ID does not exist" containerID="4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"
Jul 07 20:09:36.508942 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.508903    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682"} err="failed to get container status \"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682\": rpc error: code = NotFound desc = could not find container \"4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682\": container with ID starting with 4bb85e75a6cff73878ac033b16cc55d3a100c312e432bf65063ff25f85b67682 not found: ID does not exist"
Jul 07 20:09:36.522719 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.522670    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" podStartSLOduration=1.522652871 podStartE2EDuration="1.522652871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:09:36.52190419 +0000 UTC m=+507.362401101" watchObservedRunningTime="2026-07-07 20:09:36.522652871 +0000 UTC m=+507.363149760"
Jul 07 20:09:36.542085 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.542049    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:36.547501 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:36.547473    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2msv"]
Jul 07 20:09:37.589777 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:37.587710    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e698bb9e-d22f-418c-a62e-23546006ffe9" path="/var/lib/kubelet/pods/e698bb9e-d22f-418c-a62e-23546006ffe9/volumes"
Jul 07 20:09:47.509307 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.509276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:09:47.570157 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.570121    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:47.570441 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.570409    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" podUID="99095679-ee1b-466f-99be-a1b02bc2bee3" containerName="manager" containerID="cri-o://c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e" gracePeriod=10
Jul 07 20:09:47.828325 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.828297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:47.873104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.873067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume\") pod \"99095679-ee1b-466f-99be-a1b02bc2bee3\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") "
Jul 07 20:09:47.873280 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.873117    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx6gl\" (UniqueName: \"kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl\") pod \"99095679-ee1b-466f-99be-a1b02bc2bee3\" (UID: \"99095679-ee1b-466f-99be-a1b02bc2bee3\") "
Jul 07 20:09:47.873455 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.873434    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99095679-ee1b-466f-99be-a1b02bc2bee3" (UID: "99095679-ee1b-466f-99be-a1b02bc2bee3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:09:47.875104 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.875079    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl" (OuterVolumeSpecName: "kube-api-access-rx6gl") pod "99095679-ee1b-466f-99be-a1b02bc2bee3" (UID: "99095679-ee1b-466f-99be-a1b02bc2bee3"). InnerVolumeSpecName "kube-api-access-rx6gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:09:47.974581 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.974544    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99095679-ee1b-466f-99be-a1b02bc2bee3-extensions-socket-volume\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:47.974581 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:47.974575    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx6gl\" (UniqueName: \"kubernetes.io/projected/99095679-ee1b-466f-99be-a1b02bc2bee3-kube-api-access-rx6gl\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:09:48.553934 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.553898    2562 generic.go:356] "Generic (PLEG): container finished" podID="99095679-ee1b-466f-99be-a1b02bc2bee3" containerID="c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e" exitCode=0
Jul 07 20:09:48.554344 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.553946    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"
Jul 07 20:09:48.554344 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.553981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" event={"ID":"99095679-ee1b-466f-99be-a1b02bc2bee3","Type":"ContainerDied","Data":"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"}
Jul 07 20:09:48.554344 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.554038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b" event={"ID":"99095679-ee1b-466f-99be-a1b02bc2bee3","Type":"ContainerDied","Data":"8dfc928cfafdd8ad98bd2379f497e741f3e798ff5e31d57c05a19415f8bbdb3e"}
Jul 07 20:09:48.554344 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.554068    2562 scope.go:117] "RemoveContainer" containerID="c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"
Jul 07 20:09:48.562706 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.562689    2562 scope.go:117] "RemoveContainer" containerID="c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"
Jul 07 20:09:48.562945 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:09:48.562928    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e\": container with ID starting with c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e not found: ID does not exist" containerID="c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"
Jul 07 20:09:48.562982 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.562954    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e"} err="failed to get container status \"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e\": rpc error: code = NotFound desc = could not find container \"c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e\": container with ID starting with c2c16115a66803ce678b31c75aac5152866e33a8ea5e8afd094f5a7918d5ac6e not found: ID does not exist"
Jul 07 20:09:48.583215 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.583185    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:48.594544 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:48.594516    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6f5b"]
Jul 07 20:09:49.585582 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:09:49.585504    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99095679-ee1b-466f-99be-a1b02bc2bee3" path="/var/lib/kubelet/pods/99095679-ee1b-466f-99be-a1b02bc2bee3/volumes"
Jul 07 20:10:06.049383 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.049301    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:06.049858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.049634    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99095679-ee1b-466f-99be-a1b02bc2bee3" containerName="manager"
Jul 07 20:10:06.049858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.049646    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="99095679-ee1b-466f-99be-a1b02bc2bee3" containerName="manager"
Jul 07 20:10:06.049858 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.049703    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="99095679-ee1b-466f-99be-a1b02bc2bee3" containerName="manager"
Jul 07 20:10:06.052575 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.052557    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.055227 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.055201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zqrbq\""
Jul 07 20:10:06.055377 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.055355    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 20:10:06.061113 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.061088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:06.114563 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.114516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkw42\" (UniqueName: \"kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.114764 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.114581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.141330 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.141295    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:06.215408 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.215371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkw42\" (UniqueName: \"kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.215408 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.215415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.216042 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.216024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.225361 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.225333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkw42\" (UniqueName: \"kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42\") pod \"limitador-limitador-64c94fd64f-xz555\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.363370 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.363282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:06.473616 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.473561    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:10:06.478077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.478050    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.486583 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.486529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:10:06.504850 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.504820    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:06.507076 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:10:06.507044    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d18dc59_93f3_4058_a77d_7b0199ba1259.slice/crio-029aa566ccb2561889a18277f86f7597e314f9992a0d1f6fd3cc1445612416f5 WatchSource:0}: Error finding container 029aa566ccb2561889a18277f86f7597e314f9992a0d1f6fd3cc1445612416f5: Status 404 returned error can't find the container with id 029aa566ccb2561889a18277f86f7597e314f9992a0d1f6fd3cc1445612416f5
Jul 07 20:10:06.522741 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.522713    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:10:06.618503 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.618408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c48f3a66-f401-4947-ace7-a894f8084869-config-file\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.618503 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.618472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jjf\" (UniqueName: \"kubernetes.io/projected/c48f3a66-f401-4947-ace7-a894f8084869-kube-api-access-s7jjf\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.631508 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.631473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" event={"ID":"9d18dc59-93f3-4058-a77d-7b0199ba1259","Type":"ContainerStarted","Data":"029aa566ccb2561889a18277f86f7597e314f9992a0d1f6fd3cc1445612416f5"}
Jul 07 20:10:06.719216 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.719184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c48f3a66-f401-4947-ace7-a894f8084869-config-file\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.719417 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.719246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jjf\" (UniqueName: \"kubernetes.io/projected/c48f3a66-f401-4947-ace7-a894f8084869-kube-api-access-s7jjf\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.719881 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.719857    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c48f3a66-f401-4947-ace7-a894f8084869-config-file\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.728456 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.728425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jjf\" (UniqueName: \"kubernetes.io/projected/c48f3a66-f401-4947-ace7-a894f8084869-kube-api-access-s7jjf\") pod \"limitador-limitador-54d6d988d5-8ckdz\" (UID: \"c48f3a66-f401-4947-ace7-a894f8084869\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.791064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.791023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:06.923222 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:06.923196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:10:06.925170 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:10:06.925141    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48f3a66_f401_4947_ace7_a894f8084869.slice/crio-a441c3947ac4c561e2612a28f68078415ba8fd79556f1f10b8251050a6eece77 WatchSource:0}: Error finding container a441c3947ac4c561e2612a28f68078415ba8fd79556f1f10b8251050a6eece77: Status 404 returned error can't find the container with id a441c3947ac4c561e2612a28f68078415ba8fd79556f1f10b8251050a6eece77
Jul 07 20:10:07.649562 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:07.649444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz" event={"ID":"c48f3a66-f401-4947-ace7-a894f8084869","Type":"ContainerStarted","Data":"a441c3947ac4c561e2612a28f68078415ba8fd79556f1f10b8251050a6eece77"}
Jul 07 20:10:10.664613 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.664561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz" event={"ID":"c48f3a66-f401-4947-ace7-a894f8084869","Type":"ContainerStarted","Data":"63eaa00a5ea285310b3b041b4801d12daec924c9acadc6ec4b29672d99a37fe4"}
Jul 07 20:10:10.665037 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.664645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:10.666153 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.666134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" event={"ID":"9d18dc59-93f3-4058-a77d-7b0199ba1259","Type":"ContainerStarted","Data":"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"}
Jul 07 20:10:10.666261 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.666252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:10.682940 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.682890    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz" podStartSLOduration=1.90542305 podStartE2EDuration="4.682874861s" totalImagesPullingTime="2.777451811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:10:10.680931625 +0000 UTC m=+541.521428529" watchObservedRunningTime="2026-07-07 20:10:10.682874861 +0000 UTC m=+541.523371751"
Jul 07 20:10:10.697220 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:10.697169    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" podStartSLOduration=1.519229022 podStartE2EDuration="4.697156216s" totalImagesPullingTime="3.177927194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:10:10.695759112 +0000 UTC m=+541.536256017" watchObservedRunningTime="2026-07-07 20:10:10.697156216 +0000 UTC m=+541.537653104"
Jul 07 20:10:21.671125 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:21.671095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"
Jul 07 20:10:21.671613 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:21.671171    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:21.730158 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:21.730124    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:21.730338 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:21.730301    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" podUID="9d18dc59-93f3-4058-a77d-7b0199ba1259" containerName="limitador" containerID="cri-o://a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091" gracePeriod=30
Jul 07 20:10:22.285408 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.285383    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:22.454049 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.453960    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkw42\" (UniqueName: \"kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42\") pod \"9d18dc59-93f3-4058-a77d-7b0199ba1259\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") "
Jul 07 20:10:22.454049 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.454010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file\") pod \"9d18dc59-93f3-4058-a77d-7b0199ba1259\" (UID: \"9d18dc59-93f3-4058-a77d-7b0199ba1259\") "
Jul 07 20:10:22.454379 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.454357    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file" (OuterVolumeSpecName: "config-file") pod "9d18dc59-93f3-4058-a77d-7b0199ba1259" (UID: "9d18dc59-93f3-4058-a77d-7b0199ba1259"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 20:10:22.456068 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.456042    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42" (OuterVolumeSpecName: "kube-api-access-gkw42") pod "9d18dc59-93f3-4058-a77d-7b0199ba1259" (UID: "9d18dc59-93f3-4058-a77d-7b0199ba1259"). InnerVolumeSpecName "kube-api-access-gkw42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:10:22.554750 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.554709    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkw42\" (UniqueName: \"kubernetes.io/projected/9d18dc59-93f3-4058-a77d-7b0199ba1259-kube-api-access-gkw42\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:10:22.554750 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.554739    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d18dc59-93f3-4058-a77d-7b0199ba1259-config-file\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:10:22.718129 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.718048    2562 generic.go:356] "Generic (PLEG): container finished" podID="9d18dc59-93f3-4058-a77d-7b0199ba1259" containerID="a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091" exitCode=0
Jul 07 20:10:22.718129 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.718092    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555"
Jul 07 20:10:22.718129 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.718102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" event={"ID":"9d18dc59-93f3-4058-a77d-7b0199ba1259","Type":"ContainerDied","Data":"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"}
Jul 07 20:10:22.718644 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.718155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xz555" event={"ID":"9d18dc59-93f3-4058-a77d-7b0199ba1259","Type":"ContainerDied","Data":"029aa566ccb2561889a18277f86f7597e314f9992a0d1f6fd3cc1445612416f5"}
Jul 07 20:10:22.718644 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.718183    2562 scope.go:117] "RemoveContainer" containerID="a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"
Jul 07 20:10:22.726735 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.726718    2562 scope.go:117] "RemoveContainer" containerID="a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"
Jul 07 20:10:22.726990 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:10:22.726974    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091\": container with ID starting with a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091 not found: ID does not exist" containerID="a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"
Jul 07 20:10:22.727031 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.726999    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091"} err="failed to get container status \"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091\": rpc error: code = NotFound desc = could not find container \"a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091\": container with ID starting with a1d5633bc3949252fcbb7ce3863591b70223887a8a50643304320a36744dc091 not found: ID does not exist"
Jul 07 20:10:22.741368 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.741337    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:22.746026 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:22.746002    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xz555"]
Jul 07 20:10:23.591087 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:23.591053    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d18dc59-93f3-4058-a77d-7b0199ba1259" path="/var/lib/kubelet/pods/9d18dc59-93f3-4058-a77d-7b0199ba1259/volumes"
Jul 07 20:10:25.994404 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:25.994250    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-jz7vr"]
Jul 07 20:10:25.994863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:25.994712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d18dc59-93f3-4058-a77d-7b0199ba1259" containerName="limitador"
Jul 07 20:10:25.994863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:25.994732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d18dc59-93f3-4058-a77d-7b0199ba1259" containerName="limitador"
Jul 07 20:10:25.994863 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:25.994825    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d18dc59-93f3-4058-a77d-7b0199ba1259" containerName="limitador"
Jul 07 20:10:26.001716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.001686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.004337 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.004305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bbf74\""
Jul 07 20:10:26.004530 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.004305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 20:10:26.005469 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.005445    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jz7vr"]
Jul 07 20:10:26.184522 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.184487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-data\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.184725 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.184534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgts7\" (UniqueName: \"kubernetes.io/projected/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-kube-api-access-rgts7\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.285340 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.285304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-data\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.285534 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.285358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgts7\" (UniqueName: \"kubernetes.io/projected/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-kube-api-access-rgts7\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.285752 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.285729    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-data\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.294305 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.294283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgts7\" (UniqueName: \"kubernetes.io/projected/4ed07ca6-b12e-42ae-8ccc-f910ac122fca-kube-api-access-rgts7\") pod \"postgres-69fb4594cf-jz7vr\" (UID: \"4ed07ca6-b12e-42ae-8ccc-f910ac122fca\") " pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.316298 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.316267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:26.449025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.448997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jz7vr"]
Jul 07 20:10:26.451719 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:10:26.451693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed07ca6_b12e_42ae_8ccc_f910ac122fca.slice/crio-15a0741c8465392709f1132b28e618a09c122c0a132302447ac11acdd5e3e47b WatchSource:0}: Error finding container 15a0741c8465392709f1132b28e618a09c122c0a132302447ac11acdd5e3e47b: Status 404 returned error can't find the container with id 15a0741c8465392709f1132b28e618a09c122c0a132302447ac11acdd5e3e47b
Jul 07 20:10:26.737269 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:26.737184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jz7vr" event={"ID":"4ed07ca6-b12e-42ae-8ccc-f910ac122fca","Type":"ContainerStarted","Data":"15a0741c8465392709f1132b28e618a09c122c0a132302447ac11acdd5e3e47b"}
Jul 07 20:10:31.763125 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:31.763090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jz7vr" event={"ID":"4ed07ca6-b12e-42ae-8ccc-f910ac122fca","Type":"ContainerStarted","Data":"f3b41c096a3dda83dd1897a52b94f62b170f07eb4778257316e441fefa01ba5a"}
Jul 07 20:10:31.763534 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:31.763155    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:31.780771 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:31.780712    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-jz7vr" podStartSLOduration=2.072151425 podStartE2EDuration="6.780696484s" totalImagesPullingTime="4.708545059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:10:31.779075855 +0000 UTC m=+562.619572770" watchObservedRunningTime="2026-07-07 20:10:31.780696484 +0000 UTC m=+562.621193361"
Jul 07 20:10:37.796111 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:37.796082    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-jz7vr"
Jul 07 20:10:44.666492 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.666457    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:10:44.692477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.692446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:10:44.692670 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.692554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.696611 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.696543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qdcdp\""
Jul 07 20:10:44.696733 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.696670    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 20:10:44.697324 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.697307    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 20:10:44.717959 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.717927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.718144 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.717967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4wr\" (UniqueName: \"kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.818789 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.818760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.818789 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.818792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4wr\" (UniqueName: \"kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.821250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.821225    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:44.828156 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:44.828132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4wr\" (UniqueName: \"kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr\") pod \"maas-controller-9b6c875b7-lrrkj\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") " pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:45.003406 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:45.003313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:45.131370 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:45.131345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:10:45.133892 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:10:45.133863    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304d8a0a_2cb1_49a7_8517_794cce5d2d70.slice/crio-2873032904ebbb422badb909ce8eeca6a5c183428880e1aec1ae8d19c1dc0403 WatchSource:0}: Error finding container 2873032904ebbb422badb909ce8eeca6a5c183428880e1aec1ae8d19c1dc0403: Status 404 returned error can't find the container with id 2873032904ebbb422badb909ce8eeca6a5c183428880e1aec1ae8d19c1dc0403
Jul 07 20:10:45.823310 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:45.823273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" event={"ID":"304d8a0a-2cb1-49a7-8517-794cce5d2d70","Type":"ContainerStarted","Data":"2873032904ebbb422badb909ce8eeca6a5c183428880e1aec1ae8d19c1dc0403"}
Jul 07 20:10:47.834458 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:47.834373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" event={"ID":"304d8a0a-2cb1-49a7-8517-794cce5d2d70","Type":"ContainerStarted","Data":"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"}
Jul 07 20:10:47.834914 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:47.834500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:10:47.853330 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:47.853279    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" podStartSLOduration=1.478214859 podStartE2EDuration="3.853261853s" totalImagesPullingTime="2.375046994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:10:47.852837929 +0000 UTC m=+578.693334830" watchObservedRunningTime="2026-07-07 20:10:47.853261853 +0000 UTC m=+578.693758731"
Jul 07 20:10:58.845364 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:10:58.845331    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:11:20.236840 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.236810    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n86dc"]
Jul 07 20:11:20.248440 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.248412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.249425 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.249399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n86dc"]
Jul 07 20:11:20.251107 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.251074    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 20:11:20.251107 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.251074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-d7h2x\""
Jul 07 20:11:20.371986 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.371941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:11:20.405974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.405785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqc7p\" (UniqueName: \"kubernetes.io/projected/13322a9a-5ed0-4fd3-b989-f5618608e877-kube-api-access-wqc7p\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.405974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.405890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13322a9a-5ed0-4fd3-b989-f5618608e877-plugins-config-volume\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.506755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.506723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13322a9a-5ed0-4fd3-b989-f5618608e877-plugins-config-volume\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.506924 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.506897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqc7p\" (UniqueName: \"kubernetes.io/projected/13322a9a-5ed0-4fd3-b989-f5618608e877-kube-api-access-wqc7p\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.507645 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.507583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13322a9a-5ed0-4fd3-b989-f5618608e877-plugins-config-volume\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.515642 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.515608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqc7p\" (UniqueName: \"kubernetes.io/projected/13322a9a-5ed0-4fd3-b989-f5618608e877-kube-api-access-wqc7p\") pod \"payload-processing-58f86c7798-n86dc\" (UID: \"13322a9a-5ed0-4fd3-b989-f5618608e877\") " pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.561297 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.561261    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:20.695834 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.695805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n86dc"]
Jul 07 20:11:20.698257 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:11:20.698232    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13322a9a_5ed0_4fd3_b989_f5618608e877.slice/crio-6850836ff554d85bcec62e62607730692921cd0d2cde50de0215a04e92d7b98e WatchSource:0}: Error finding container 6850836ff554d85bcec62e62607730692921cd0d2cde50de0215a04e92d7b98e: Status 404 returned error can't find the container with id 6850836ff554d85bcec62e62607730692921cd0d2cde50de0215a04e92d7b98e
Jul 07 20:11:20.974824 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:20.974739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-n86dc" event={"ID":"13322a9a-5ed0-4fd3-b989-f5618608e877","Type":"ContainerStarted","Data":"6850836ff554d85bcec62e62607730692921cd0d2cde50de0215a04e92d7b98e"}
Jul 07 20:11:22.984602 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:22.984561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-n86dc" event={"ID":"13322a9a-5ed0-4fd3-b989-f5618608e877","Type":"ContainerStarted","Data":"a669754919825d3dad917b488b464a41e9405e807a4cf0772b88745f8e6ae20b"}
Jul 07 20:11:22.984982 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:22.984661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:23.003326 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:23.003269    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-n86dc" podStartSLOduration=1.410809345 podStartE2EDuration="3.003248304s" totalImagesPullingTime="1.592438959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:11:23.002023072 +0000 UTC m=+613.842519978" watchObservedRunningTime="2026-07-07 20:11:23.003248304 +0000 UTC m=+613.843745187"
Jul 07 20:11:33.990792 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:33.990721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-n86dc"
Jul 07 20:11:42.630599 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:42.630549    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:11:50.230315 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:11:50.230283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:12:07.930740 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:07.930699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:12:14.026849 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:14.026812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:12:18.160217 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.160175    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"]
Jul 07 20:12:18.164253 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.164228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.167867 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.167842    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 20:12:18.168004 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.167846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 20:12:18.168004 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.167849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8k5vx\""
Jul 07 20:12:18.168004 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.167905    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 20:12:18.174160 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.174137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"]
Jul 07 20:12:18.287830 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9ql\" (UniqueName: \"kubernetes.io/projected/108677dc-9959-41ca-ad2e-fe0d186e468a-kube-api-access-jl9ql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.288030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.288030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/108677dc-9959-41ca-ad2e-fe0d186e468a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.288030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.288030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.288030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.287994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389177 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9ql\" (UniqueName: \"kubernetes.io/projected/108677dc-9959-41ca-ad2e-fe0d186e468a-kube-api-access-jl9ql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389177 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389427 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/108677dc-9959-41ca-ad2e-fe0d186e468a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389427 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389427 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389427 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389752 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.389808 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.389764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.391494 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.391472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/108677dc-9959-41ca-ad2e-fe0d186e468a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.391667 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.391651    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/108677dc-9959-41ca-ad2e-fe0d186e468a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.397469 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.397445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9ql\" (UniqueName: \"kubernetes.io/projected/108677dc-9959-41ca-ad2e-fe0d186e468a-kube-api-access-jl9ql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vbnmz\" (UID: \"108677dc-9959-41ca-ad2e-fe0d186e468a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.474760 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.474675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:18.605938 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.605913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"]
Jul 07 20:12:18.608914 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:12:18.608887    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108677dc_9959_41ca_ad2e_fe0d186e468a.slice/crio-6bcdc663e1d269dcd32693b01416df185cb0f8222546e498414ecf82fb019037 WatchSource:0}: Error finding container 6bcdc663e1d269dcd32693b01416df185cb0f8222546e498414ecf82fb019037: Status 404 returned error can't find the container with id 6bcdc663e1d269dcd32693b01416df185cb0f8222546e498414ecf82fb019037
Jul 07 20:12:18.610268 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:18.610249    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 20:12:19.217980 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:19.217932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz" event={"ID":"108677dc-9959-41ca-ad2e-fe0d186e468a","Type":"ContainerStarted","Data":"6bcdc663e1d269dcd32693b01416df185cb0f8222546e498414ecf82fb019037"}
Jul 07 20:12:20.223405 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:20.223370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz" event={"ID":"108677dc-9959-41ca-ad2e-fe0d186e468a","Type":"ContainerStarted","Data":"84951c7e8676663962cd72597e5581ed09ce007194e109f895c16d57dca89481"}
Jul 07 20:12:20.244256 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:20.244208    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz" podStartSLOduration=1.2007368330000001 podStartE2EDuration="2.244192545s" totalImagesPullingTime="1.043455712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:12:20.243291437 +0000 UTC m=+671.083788340" watchObservedRunningTime="2026-07-07 20:12:20.244192545 +0000 UTC m=+671.084689422"
Jul 07 20:12:20.330695 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:20.330657    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:12:28.475030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:28.474993    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:28.475518 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:28.475059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:28.487560 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:28.487534    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:29.274206 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:29.274176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vbnmz"
Jul 07 20:12:36.626201 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:12:36.626164    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:11.231234 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:11.231196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:21.333729 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:21.333691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:31.437562 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:31.437476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:41.326320 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:41.326283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:51.529453 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:51.529418    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:14:54.372286 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.372256    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:14:54.372727 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.372457    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" podUID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" containerName="manager" containerID="cri-o://a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840" gracePeriod=30
Jul 07 20:14:54.619912 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.619887    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:14:54.700562 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.700478    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb4wr\" (UniqueName: \"kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr\") pod \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") "
Jul 07 20:14:54.700562 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.700530    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert\") pod \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\" (UID: \"304d8a0a-2cb1-49a7-8517-794cce5d2d70\") "
Jul 07 20:14:54.702564 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.702537    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "304d8a0a-2cb1-49a7-8517-794cce5d2d70" (UID: "304d8a0a-2cb1-49a7-8517-794cce5d2d70"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:14:54.702687 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.702621    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr" (OuterVolumeSpecName: "kube-api-access-rb4wr") pod "304d8a0a-2cb1-49a7-8517-794cce5d2d70" (UID: "304d8a0a-2cb1-49a7-8517-794cce5d2d70"). InnerVolumeSpecName "kube-api-access-rb4wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:14:54.801901 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.801865    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb4wr\" (UniqueName: \"kubernetes.io/projected/304d8a0a-2cb1-49a7-8517-794cce5d2d70-kube-api-access-rb4wr\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:14:54.801901 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.801896    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/304d8a0a-2cb1-49a7-8517-794cce5d2d70-webhook-cert\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:14:54.890934 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.890899    2562 generic.go:356] "Generic (PLEG): container finished" podID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" containerID="a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840" exitCode=0
Jul 07 20:14:54.891126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.890945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-lrrkj"
Jul 07 20:14:54.891126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.890991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" event={"ID":"304d8a0a-2cb1-49a7-8517-794cce5d2d70","Type":"ContainerDied","Data":"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"}
Jul 07 20:14:54.891126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.891048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-lrrkj" event={"ID":"304d8a0a-2cb1-49a7-8517-794cce5d2d70","Type":"ContainerDied","Data":"2873032904ebbb422badb909ce8eeca6a5c183428880e1aec1ae8d19c1dc0403"}
Jul 07 20:14:54.891126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.891077    2562 scope.go:117] "RemoveContainer" containerID="a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"
Jul 07 20:14:54.899477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.899459    2562 scope.go:117] "RemoveContainer" containerID="a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"
Jul 07 20:14:54.899800 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:14:54.899780    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840\": container with ID starting with a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840 not found: ID does not exist" containerID="a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"
Jul 07 20:14:54.899870 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.899807    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840"} err="failed to get container status \"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840\": rpc error: code = NotFound desc = could not find container \"a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840\": container with ID starting with a7653e26c3e7558ee142505a52ffbc07a47c2f97532199323a8c1f1132599840 not found: ID does not exist"
Jul 07 20:14:54.911494 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.911470    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:14:54.915434 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:54.915409    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-lrrkj"]
Jul 07 20:14:55.585166 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.585135    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" path="/var/lib/kubelet/pods/304d8a0a-2cb1-49a7-8517-794cce5d2d70/volumes"
Jul 07 20:14:55.729990 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.729932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9b6c875b7-vgq8h"]
Jul 07 20:14:55.730258 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.730245    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" containerName="manager"
Jul 07 20:14:55.730310 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.730260    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" containerName="manager"
Jul 07 20:14:55.730347 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.730324    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="304d8a0a-2cb1-49a7-8517-794cce5d2d70" containerName="manager"
Jul 07 20:14:55.733399 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.733379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.735944 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.735926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 20:14:55.737003 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.736985    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 20:14:55.737109 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.737093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qdcdp\""
Jul 07 20:14:55.742236 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.742213    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-vgq8h"]
Jul 07 20:14:55.810810 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.810774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2e2236-3ee8-4060-82a9-deabc18ca483-webhook-cert\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.810978 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.810826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlkpx\" (UniqueName: \"kubernetes.io/projected/2f2e2236-3ee8-4060-82a9-deabc18ca483-kube-api-access-rlkpx\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.912060 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.911967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2e2236-3ee8-4060-82a9-deabc18ca483-webhook-cert\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.912060 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.912023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkpx\" (UniqueName: \"kubernetes.io/projected/2f2e2236-3ee8-4060-82a9-deabc18ca483-kube-api-access-rlkpx\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.914315 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.914296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2e2236-3ee8-4060-82a9-deabc18ca483-webhook-cert\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:55.921465 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:55.921437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlkpx\" (UniqueName: \"kubernetes.io/projected/2f2e2236-3ee8-4060-82a9-deabc18ca483-kube-api-access-rlkpx\") pod \"maas-controller-9b6c875b7-vgq8h\" (UID: \"2f2e2236-3ee8-4060-82a9-deabc18ca483\") " pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:56.043973 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.043932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:56.176409 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.176368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b6c875b7-vgq8h"]
Jul 07 20:14:56.178895 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:14:56.178862    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2e2236_3ee8_4060_82a9_deabc18ca483.slice/crio-de75cf0ad3a065b429ba09cec76d33a565f4aec75d8ec5adf57a2890f4d7c988 WatchSource:0}: Error finding container de75cf0ad3a065b429ba09cec76d33a565f4aec75d8ec5adf57a2890f4d7c988: Status 404 returned error can't find the container with id de75cf0ad3a065b429ba09cec76d33a565f4aec75d8ec5adf57a2890f4d7c988
Jul 07 20:14:56.902741 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.902703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-vgq8h" event={"ID":"2f2e2236-3ee8-4060-82a9-deabc18ca483","Type":"ContainerStarted","Data":"2fbb799c099071f656b4b2f17c8878fe851354d8e33908ca06657f8dc8dfdd7f"}
Jul 07 20:14:56.903130 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.902760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b6c875b7-vgq8h" event={"ID":"2f2e2236-3ee8-4060-82a9-deabc18ca483","Type":"ContainerStarted","Data":"de75cf0ad3a065b429ba09cec76d33a565f4aec75d8ec5adf57a2890f4d7c988"}
Jul 07 20:14:56.903130 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.902788    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:14:56.921949 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:14:56.921889    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9b6c875b7-vgq8h" podStartSLOduration=1.382722324 podStartE2EDuration="1.921869191s" totalImagesPullingTime="539.146867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:14:56.921325356 +0000 UTC m=+827.761822253" watchObservedRunningTime="2026-07-07 20:14:56.921869191 +0000 UTC m=+827.762366070"
Jul 07 20:15:07.912983 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:15:07.912954    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9b6c875b7-vgq8h"
Jul 07 20:15:18.933788 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:15:18.933751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:15:30.638077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:15:30.638041    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:06.327867 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:06.327787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:16.042781 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:16.042747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:24.440353 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:24.440313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:34.836478 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:34.836444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:42.934860 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:42.934825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:16:54.335659 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:16:54.335616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:17:05.427272 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:17:05.427236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:17:15.124630 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:17:15.124574    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:17:37.925519 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:17:37.925439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:17:46.936849 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:17:46.936816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:18:10.029807 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:18:10.029774    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:18:21.029734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:18:21.029695    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:18:38.924390 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:18:38.924353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:18:47.424994 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:18:47.424956    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:18:56.431622 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:18:56.431577    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:19:05.930268 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:05.930180    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:19:16.020441 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:16.020407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:19:42.951875 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:42.951840    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:19:42.952432 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:42.952090    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" podUID="67281304-9659-4b52-b669-537a08b4473a" containerName="manager" containerID="cri-o://26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5" gracePeriod=10
Jul 07 20:19:45.499090 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.499066    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:19:45.531198 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.531115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume\") pod \"67281304-9659-4b52-b669-537a08b4473a\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") "
Jul 07 20:19:45.531198 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.531167    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9bzd\" (UniqueName: \"kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd\") pod \"67281304-9659-4b52-b669-537a08b4473a\" (UID: \"67281304-9659-4b52-b669-537a08b4473a\") "
Jul 07 20:19:45.531454 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.531430    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67281304-9659-4b52-b669-537a08b4473a" (UID: "67281304-9659-4b52-b669-537a08b4473a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:19:45.533335 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.533308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd" (OuterVolumeSpecName: "kube-api-access-h9bzd") pod "67281304-9659-4b52-b669-537a08b4473a" (UID: "67281304-9659-4b52-b669-537a08b4473a"). InnerVolumeSpecName "kube-api-access-h9bzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:19:45.632603 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.632568    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67281304-9659-4b52-b669-537a08b4473a-extensions-socket-volume\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:19:45.632757 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:45.632616    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9bzd\" (UniqueName: \"kubernetes.io/projected/67281304-9659-4b52-b669-537a08b4473a-kube-api-access-h9bzd\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:19:46.151732 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.151696    2562 generic.go:356] "Generic (PLEG): container finished" podID="67281304-9659-4b52-b669-537a08b4473a" containerID="26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5" exitCode=0
Jul 07 20:19:46.151913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.151743    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"
Jul 07 20:19:46.151913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.151793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" event={"ID":"67281304-9659-4b52-b669-537a08b4473a","Type":"ContainerDied","Data":"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"}
Jul 07 20:19:46.151913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.151840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s" event={"ID":"67281304-9659-4b52-b669-537a08b4473a","Type":"ContainerDied","Data":"978f05b35cff3dbad54deda53070e4cb834a1e727e25fc226bd7589bf295ab2b"}
Jul 07 20:19:46.151913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.151867    2562 scope.go:117] "RemoveContainer" containerID="26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"
Jul 07 20:19:46.160669 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.160650    2562 scope.go:117] "RemoveContainer" containerID="26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"
Jul 07 20:19:46.160967 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:19:46.160950    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5\": container with ID starting with 26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5 not found: ID does not exist" containerID="26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"
Jul 07 20:19:46.161012 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.160975    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5"} err="failed to get container status \"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5\": rpc error: code = NotFound desc = could not find container \"26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5\": container with ID starting with 26c8e4efa5e8336f2ac4679714ee15d98ce7c6d1869d45f07254ed494094a8a5 not found: ID does not exist"
Jul 07 20:19:46.172688 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.172660    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:19:46.177312 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:46.177285    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bqv8s"]
Jul 07 20:19:47.585502 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:19:47.585468    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67281304-9659-4b52-b669-537a08b4473a" path="/var/lib/kubelet/pods/67281304-9659-4b52-b669-537a08b4473a/volumes"
Jul 07 20:20:44.188765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.188670    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"]
Jul 07 20:20:44.189225 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.188991    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67281304-9659-4b52-b669-537a08b4473a" containerName="manager"
Jul 07 20:20:44.189225 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.189001    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67281304-9659-4b52-b669-537a08b4473a" containerName="manager"
Jul 07 20:20:44.189225 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.189082    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67281304-9659-4b52-b669-537a08b4473a" containerName="manager"
Jul 07 20:20:44.191831 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.191813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.194171 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.194153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4tsr7\""
Jul 07 20:20:44.203826 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.203804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"]
Jul 07 20:20:44.313386 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.313347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.313558 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.313399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvz7s\" (UniqueName: \"kubernetes.io/projected/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-kube-api-access-nvz7s\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.414183 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.414146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.414367 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.414202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvz7s\" (UniqueName: \"kubernetes.io/projected/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-kube-api-access-nvz7s\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.414610 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.414571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.424694 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.424671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvz7s\" (UniqueName: \"kubernetes.io/projected/6348adf0-b9fa-4d29-ba8e-b6b85286d4b7-kube-api-access-nvz7s\") pod \"kuadrant-operator-controller-manager-86878c769f-z8lqc\" (UID: \"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.501789 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.501692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:44.632006 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:44.631982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"]
Jul 07 20:20:44.634681 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:20:44.634647    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6348adf0_b9fa_4d29_ba8e_b6b85286d4b7.slice/crio-d48b2ad6dc4b372255d4cac316f51723c283346a90c0b9fc3a52e705e48b0666 WatchSource:0}: Error finding container d48b2ad6dc4b372255d4cac316f51723c283346a90c0b9fc3a52e705e48b0666: Status 404 returned error can't find the container with id d48b2ad6dc4b372255d4cac316f51723c283346a90c0b9fc3a52e705e48b0666
Jul 07 20:20:45.400554 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:45.400522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc" event={"ID":"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7","Type":"ContainerStarted","Data":"14467a3fc56cc7f8990333dbc691684e600786ff9a584cc868b32ed426ce2411"}
Jul 07 20:20:45.400955 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:45.400569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc" event={"ID":"6348adf0-b9fa-4d29-ba8e-b6b85286d4b7","Type":"ContainerStarted","Data":"d48b2ad6dc4b372255d4cac316f51723c283346a90c0b9fc3a52e705e48b0666"}
Jul 07 20:20:45.400955 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:45.400624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:20:45.424239 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:45.424184    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc" podStartSLOduration=1.4241680319999999 podStartE2EDuration="1.424168032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:20:45.424083433 +0000 UTC m=+1176.264580312" watchObservedRunningTime="2026-07-07 20:20:45.424168032 +0000 UTC m=+1176.264664909"
Jul 07 20:20:56.407292 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:20:56.407253    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8lqc"
Jul 07 20:21:04.824194 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:04.824160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:21:15.528051 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:15.528012    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:21:25.622658 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:25.622617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:21:36.631019 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:36.630989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:21:47.422960 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:47.422924    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:21:58.931644 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:21:58.931580    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:22:08.227572 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:22:08.227482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:22:19.589950 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:22:19.589913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:22:29.752977 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:22:29.752940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:22:39.233381 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:22:39.233345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:22:52.166520 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:22:52.166475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:23:10.818720 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:23:10.818683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:23:20.080902 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:23:20.080873    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:23:31.148851 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:23:31.148810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:23:43.342522 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:23:43.342487    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:00.334781 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:00.334741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:12.127913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:12.127875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:20.921765 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:20.921726    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:30.638298 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:30.638258    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:39.531201 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:39.531170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:24:49.726979 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:24:49.726940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:02.144698 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:02.144610    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:12.424216 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:12.424177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:28.222454 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:28.222420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:35.634136 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:35.634101    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:46.933252 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:46.933214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:25:55.834763 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:25:55.834735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:03.338738 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:03.338699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:15.232950 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:15.232913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:28.226499 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:28.226460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:35.623639 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:35.623529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:47.528513 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:47.528477    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:26:55.830580 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:26:55.830538    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:27:07.525753 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:27:07.525714    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:27:16.238519 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:27:16.238480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:27:39.023006 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:27:39.022970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:27:47.230175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:27:47.230142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:29:12.034317 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:29:12.034279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:29:20.741417 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:29:20.741378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:29:34.134577 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:29:34.134497    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:29:45.238091 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:29:45.238056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:30:15.932103 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:30:15.932073    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:30:31.730335 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:30:31.730300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:30:45.828506 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:30:45.828475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:30:58.948775 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:30:58.948736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:31:43.287317 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:31:43.287280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:31:55.737681 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:31:55.737645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:32:04.569070 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:32:04.569033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:32:49.929424 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:32:49.929389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:33:00.125608 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:00.125550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:33:08.825048 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:08.825016    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:33:18.926677 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:18.926639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:33:45.678787 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.678750    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:33:45.681839 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.681819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.685671 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.685649    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-080fc2\"/\"openshift-service-ca.crt\""
Jul 07 20:33:45.685671 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.685659    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-080fc2\"/\"kube-root-ca.crt\""
Jul 07 20:33:45.685828 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.685661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-080fc2\"/\"test-model-080fc2-kserve-self-signed-certs\""
Jul 07 20:33:45.685828 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.685660    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-080fc2\"/\"default-dockercfg-mc7hr\""
Jul 07 20:33:45.694746 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.694724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:33:45.784898 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.784862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmtg\" (UniqueName: \"kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.785094 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.784909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.785094 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.784958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.785094 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.784992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.785094 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.785044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.785094 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.785079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.885985 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.885944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.885985 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.885990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmtg\" (UniqueName: \"kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886238 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886455 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886508 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886460    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.886548 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.886508    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.888436 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.888419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.888529 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.888510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.897033 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.897010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmtg\" (UniqueName: \"kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg\") pod \"test-model-080fc2-kserve-689bbdf4f9-tx4md\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") " pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:45.990874 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:45.990787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:46.127507 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:46.127482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:33:46.129214 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:33:46.129185    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode295f6c8_a05c_4aca_b7d1_3de0b84df64c.slice/crio-0d44726b165ef579b4460b419041295b18c20f20985523bf93609c7d449d9730 WatchSource:0}: Error finding container 0d44726b165ef579b4460b419041295b18c20f20985523bf93609c7d449d9730: Status 404 returned error can't find the container with id 0d44726b165ef579b4460b419041295b18c20f20985523bf93609c7d449d9730
Jul 07 20:33:46.791735 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:46.791697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" event={"ID":"e295f6c8-a05c-4aca-b7d1-3de0b84df64c","Type":"ContainerStarted","Data":"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"}
Jul 07 20:33:46.792120 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:46.791747    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" event={"ID":"e295f6c8-a05c-4aca-b7d1-3de0b84df64c","Type":"ContainerStarted","Data":"0d44726b165ef579b4460b419041295b18c20f20985523bf93609c7d449d9730"}
Jul 07 20:33:46.812623 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:46.812547    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" podStartSLOduration=1.812531906 podStartE2EDuration="1.812531906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:33:46.811144716 +0000 UTC m=+1957.651641584" watchObservedRunningTime="2026-07-07 20:33:46.812531906 +0000 UTC m=+1957.653028783"
Jul 07 20:33:49.831463 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:49.831430    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:33:55.991653 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:55.991618    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:55.992064 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:55.991710    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:56.004354 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:56.004323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:33:56.845526 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:33:56.845500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:34:02.332698 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:02.332610    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:34:12.903943 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:12.903909    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:34:18.131067 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:18.131028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:34:27.924013 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:27.923941    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" podUID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" containerName="main" containerID="cri-o://8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92" gracePeriod=45
Jul 07 20:34:28.165414 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.165392    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:34:28.248221 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248141    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248221 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248188    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248221 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248220    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248486 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248486 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248273    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248486 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvmtg\" (UniqueName: \"kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg\") pod \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\" (UID: \"e295f6c8-a05c-4aca-b7d1-3de0b84df64c\") "
Jul 07 20:34:28.248486 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248421    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:34:28.248701 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248536    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home" (OuterVolumeSpecName: "home") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:34:28.248701 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.248545    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache" (OuterVolumeSpecName: "model-cache") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:34:28.250419 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.250399    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm" (OuterVolumeSpecName: "dshm") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:34:28.250512 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.250496    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:34:28.250601 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.250570    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg" (OuterVolumeSpecName: "kube-api-access-xvmtg") pod "e295f6c8-a05c-4aca-b7d1-3de0b84df64c" (UID: "e295f6c8-a05c-4aca-b7d1-3de0b84df64c"). InnerVolumeSpecName "kube-api-access-xvmtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:34:28.349151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349098    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tls-certs\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.349151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349143    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-dshm\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.349151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349155    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-model-cache\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.349378 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349167    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvmtg\" (UniqueName: \"kubernetes.io/projected/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-kube-api-access-xvmtg\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.349378 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349180    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-tmp-dir\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.349378 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.349192    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e295f6c8-a05c-4aca-b7d1-3de0b84df64c-home\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:34:28.973825 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.973790    2562 generic.go:356] "Generic (PLEG): container finished" podID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" containerID="8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92" exitCode=0
Jul 07 20:34:28.974233 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.973834    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"
Jul 07 20:34:28.974233 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.973871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" event={"ID":"e295f6c8-a05c-4aca-b7d1-3de0b84df64c","Type":"ContainerDied","Data":"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"}
Jul 07 20:34:28.974233 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.973913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md" event={"ID":"e295f6c8-a05c-4aca-b7d1-3de0b84df64c","Type":"ContainerDied","Data":"0d44726b165ef579b4460b419041295b18c20f20985523bf93609c7d449d9730"}
Jul 07 20:34:28.974233 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.973931    2562 scope.go:117] "RemoveContainer" containerID="8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"
Jul 07 20:34:28.982829 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.982812    2562 scope.go:117] "RemoveContainer" containerID="8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"
Jul 07 20:34:28.983088 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:34:28.983069    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92\": container with ID starting with 8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92 not found: ID does not exist" containerID="8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"
Jul 07 20:34:28.983133 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.983095    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92"} err="failed to get container status \"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92\": rpc error: code = NotFound desc = could not find container \"8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92\": container with ID starting with 8e4c67d07e8f076c581d24944f0417590547824859a683ae13d4c269d8c2dd92 not found: ID does not exist"
Jul 07 20:34:28.996543 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:28.996522    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:34:29.000867 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:29.000844    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-080fc2/test-model-080fc2-kserve-689bbdf4f9-tx4md"]
Jul 07 20:34:29.586449 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:29.586411    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" path="/var/lib/kubelet/pods/e295f6c8-a05c-4aca-b7d1-3de0b84df64c/volumes"
Jul 07 20:34:59.926735 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:34:59.926700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:35:13.627766 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:35:13.627728    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:35:27.230946 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:35:27.230911    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:35:37.422627 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:35:37.422577    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:35:50.225116 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:35:50.225079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:36:00.934831 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:00.934789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:36:16.972724 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.972687    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:36:16.973175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.973030    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" containerName="main"
Jul 07 20:36:16.973175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.973042    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" containerName="main"
Jul 07 20:36:16.973175 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.973107    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e295f6c8-a05c-4aca-b7d1-3de0b84df64c" containerName="main"
Jul 07 20:36:16.978997 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.978961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:16.982137 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.982102    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"openshift-service-ca.crt\""
Jul 07 20:36:16.983751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.983296    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"kube-root-ca.crt\""
Jul 07 20:36:16.983890 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.983755    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"auth-test-model-e9f8cf-kserve-self-signed-certs\""
Jul 07 20:36:16.984115 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.984097    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"default-dockercfg-qkgh4\""
Jul 07 20:36:16.987312 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:16.987288    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:36:17.060523 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnnh\" (UniqueName: \"kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.060734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.060734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.060734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.060734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.060734 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.060717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161323 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161323 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161542 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161542 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161542 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161542 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnnh\" (UniqueName: \"kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161886 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161855    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.161886 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161874    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.162077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.161927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.163637 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.163615    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.163835 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.163815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.172647 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.172621    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnnh\" (UniqueName: \"kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh\") pod \"auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") " pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.290540 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.290495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:17.423879 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.423853    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:36:17.426330 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:36:17.426302    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod610e1aeb_86c7_4b9b_957b_fc46a0fa69c5.slice/crio-6d6bcb0f05b936585f434342ab5a81640111e5a8c9470059f552b01626bddedb WatchSource:0}: Error finding container 6d6bcb0f05b936585f434342ab5a81640111e5a8c9470059f552b01626bddedb: Status 404 returned error can't find the container with id 6d6bcb0f05b936585f434342ab5a81640111e5a8c9470059f552b01626bddedb
Jul 07 20:36:17.442184 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:17.442155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" event={"ID":"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5","Type":"ContainerStarted","Data":"6d6bcb0f05b936585f434342ab5a81640111e5a8c9470059f552b01626bddedb"}
Jul 07 20:36:18.447842 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:18.447802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" event={"ID":"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5","Type":"ContainerStarted","Data":"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"}
Jul 07 20:36:18.467041 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:18.466987    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" podStartSLOduration=2.466971162 podStartE2EDuration="2.466971162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:36:18.46561978 +0000 UTC m=+2109.306116659" watchObservedRunningTime="2026-07-07 20:36:18.466971162 +0000 UTC m=+2109.307468040"
Jul 07 20:36:20.228809 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:20.228777    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:36:27.290913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:27.290878    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:27.290913 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:27.290921    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:27.303444 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:27.303416    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:27.499816 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:27.499791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:36:59.328565 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:36:59.328527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:37:17.826848 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:37:17.826812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:37:32.337864 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:37:32.337827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:37:46.034022 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:37:46.033990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:38:03.935795 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:38:03.935760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:38:21.132856 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:38:21.132812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:38:36.336873 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:38:36.336791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:38:53.243389 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:38:53.243356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:38:57.893889 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:38:57.893855    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:39:09.127759 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:09.127727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:39:12.914232 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:12.914173    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" podUID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" containerName="main" containerID="cri-o://40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd" gracePeriod=45
Jul 07 20:39:13.168223 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.168156    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:39:13.204203 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.204162    2562 generic.go:356] "Generic (PLEG): container finished" podID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" containerID="40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd" exitCode=0
Jul 07 20:39:13.204203 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.204202    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"
Jul 07 20:39:13.204419 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.204230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" event={"ID":"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5","Type":"ContainerDied","Data":"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"}
Jul 07 20:39:13.204419 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.204272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c" event={"ID":"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5","Type":"ContainerDied","Data":"6d6bcb0f05b936585f434342ab5a81640111e5a8c9470059f552b01626bddedb"}
Jul 07 20:39:13.204419 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.204296    2562 scope.go:117] "RemoveContainer" containerID="40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"
Jul 07 20:39:13.212640 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.212624    2562 scope.go:117] "RemoveContainer" containerID="40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"
Jul 07 20:39:13.212920 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:39:13.212900    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd\": container with ID starting with 40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd not found: ID does not exist" containerID="40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"
Jul 07 20:39:13.212997 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.212927    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd"} err="failed to get container status \"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd\": rpc error: code = NotFound desc = could not find container \"40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd\": container with ID starting with 40f4f1c5cb6e55467fbfc3ae581e03266d7f82fd0987bbf4718b83a35afe8dcd not found: ID does not exist"
Jul 07 20:39:13.269807 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269768    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.269807 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269806    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.270033 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.270033 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269867    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtnnh\" (UniqueName: \"kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.270033 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269895    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.270033 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.269912    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache\") pod \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\" (UID: \"610e1aeb-86c7-4b9b-957b-fc46a0fa69c5\") "
Jul 07 20:39:13.270252 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.270092    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:39:13.270252 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.270110    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home" (OuterVolumeSpecName: "home") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:39:13.270361 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.270280    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:39:13.272093 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.272062    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm" (OuterVolumeSpecName: "dshm") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:39:13.272206 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.272187    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh" (OuterVolumeSpecName: "kube-api-access-rtnnh") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "kube-api-access-rtnnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:39:13.272385 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.272365    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" (UID: "610e1aeb-86c7-4b9b-957b-fc46a0fa69c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:39:13.371055 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371017    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tmp-dir\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.371055 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371056    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtnnh\" (UniqueName: \"kubernetes.io/projected/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-kube-api-access-rtnnh\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.371255 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371070    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-tls-certs\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.371255 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371084    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-model-cache\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.371255 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371095    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-dshm\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.371255 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.371106    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5-home\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:39:13.529992 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.529965    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:39:13.533939 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.533915    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/auth-test-model-e9f8cf-kserve-7f9b5fd7f5-74d9c"]
Jul 07 20:39:13.586100 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:13.586069    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" path="/var/lib/kubelet/pods/610e1aeb-86c7-4b9b-957b-fc46a0fa69c5/volumes"
Jul 07 20:39:14.674401 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.674367    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:39:14.674881 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.674864    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" containerName="main"
Jul 07 20:39:14.674934 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.674885    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" containerName="main"
Jul 07 20:39:14.674987 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.674976    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="610e1aeb-86c7-4b9b-957b-fc46a0fa69c5" containerName="main"
Jul 07 20:39:14.679569 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.679548    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.683172 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.683147    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"default-dockercfg-qkgh4\""
Jul 07 20:39:14.683296 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.683147    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"openshift-service-ca.crt\""
Jul 07 20:39:14.683296 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.683155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"sub-test-model-e9f8cf-kserve-self-signed-certs\""
Jul 07 20:39:14.683296 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.683221    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"kube-root-ca.crt\""
Jul 07 20:39:14.688627 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.688602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:39:14.784511 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4cj\" (UniqueName: \"kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.784716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.784716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.784716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.784716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.784716 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.784702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885825 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4cj\" (UniqueName: \"kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.885976 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.885948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.886326 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.886306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.886389 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.886331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.886448 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.886433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.888071 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.888049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.888235 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.888219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.895447 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.895424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4cj\" (UniqueName: \"kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj\") pod \"sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") " pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:14.990670 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:14.990554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:15.122097 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:15.121990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:39:15.124393 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:39:15.124368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83460b40_02be_40e1_a1f6_2864860067b7.slice/crio-e6af1b83c94e23ef96e766ba3630b654a02cd3e67262066e2e29f047d9cfafb0 WatchSource:0}: Error finding container e6af1b83c94e23ef96e766ba3630b654a02cd3e67262066e2e29f047d9cfafb0: Status 404 returned error can't find the container with id e6af1b83c94e23ef96e766ba3630b654a02cd3e67262066e2e29f047d9cfafb0
Jul 07 20:39:15.216130 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:15.216100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" event={"ID":"83460b40-02be-40e1-a1f6-2864860067b7","Type":"ContainerStarted","Data":"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"}
Jul 07 20:39:15.216294 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:15.216140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" event={"ID":"83460b40-02be-40e1-a1f6-2864860067b7","Type":"ContainerStarted","Data":"e6af1b83c94e23ef96e766ba3630b654a02cd3e67262066e2e29f047d9cfafb0"}
Jul 07 20:39:15.236768 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:15.236722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" podStartSLOduration=1.236707998 podStartE2EDuration="1.236707998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:39:15.234547054 +0000 UTC m=+2286.075043947" watchObservedRunningTime="2026-07-07 20:39:15.236707998 +0000 UTC m=+2286.077204853"
Jul 07 20:39:17.726719 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:17.726688    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:39:24.991138 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:24.991096    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:24.991138 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:24.991145    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:25.003827 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:25.003797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:25.271111 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:25.271084    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:39:54.329791 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:39:54.329758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:40:24.632043 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:24.631999    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:40:41.538497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:41.538460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:40:47.166697 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:47.166661    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:40:54.776699 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.776660    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:40:54.779831 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.779814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.782515 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.782495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9f8cf\"/\"rate-test-model-e9f8cf-kserve-self-signed-certs\""
Jul 07 20:40:54.788643 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.788621    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:40:54.822185 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.822185 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.822396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2wm\" (UniqueName: \"kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.822396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.822396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.822513 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.822399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923539 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923539 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2wm\" (UniqueName: \"kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.923836 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.924029 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.923983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.924029 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.924009    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.924114 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.924066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.925847 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.925826    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.926096 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.926076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:54.931964 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:54.931942    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2wm\" (UniqueName: \"kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm\") pod \"rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") " pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:55.089495 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:55.089393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:40:55.230297 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:55.230273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:40:55.232207 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:40:55.232165    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf68b917a_ca64_4aef_920b_548a269968fe.slice/crio-aeff4d7d31691791b2ac232a5b1ea257579dcc274bf74b5f530d9af5decbcdb0 WatchSource:0}: Error finding container aeff4d7d31691791b2ac232a5b1ea257579dcc274bf74b5f530d9af5decbcdb0: Status 404 returned error can't find the container with id aeff4d7d31691791b2ac232a5b1ea257579dcc274bf74b5f530d9af5decbcdb0
Jul 07 20:40:55.643098 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:55.643062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" event={"ID":"f68b917a-ca64-4aef-920b-548a269968fe","Type":"ContainerStarted","Data":"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"}
Jul 07 20:40:55.643098 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:55.643101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" event={"ID":"f68b917a-ca64-4aef-920b-548a269968fe","Type":"ContainerStarted","Data":"aeff4d7d31691791b2ac232a5b1ea257579dcc274bf74b5f530d9af5decbcdb0"}
Jul 07 20:40:55.663735 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:55.663686    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" podStartSLOduration=1.6636714929999998 podStartE2EDuration="1.663671493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 20:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:40:55.661876952 +0000 UTC m=+2386.502373831" watchObservedRunningTime="2026-07-07 20:40:55.663671493 +0000 UTC m=+2386.504168382"
Jul 07 20:40:58.224689 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:40:58.224655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:41:02.187489 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.187425    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" podUID="83460b40-02be-40e1-a1f6-2864860067b7" containerName="main" containerID="cri-o://7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9" gracePeriod=45
Jul 07 20:41:02.449680 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.449617    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:41:02.488151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488118    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488327 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488197    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k4cj\" (UniqueName: \"kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488327 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488217    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488327 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488327 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488249    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488327 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache\") pod \"83460b40-02be-40e1-a1f6-2864860067b7\" (UID: \"83460b40-02be-40e1-a1f6-2864860067b7\") "
Jul 07 20:41:02.488615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488442    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home" (OuterVolumeSpecName: "home") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:41:02.488615 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488527    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-home\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.488732 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488679    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:41:02.488732 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.488718    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:41:02.490521 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.490492    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm" (OuterVolumeSpecName: "dshm") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:41:02.490665 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.490523    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj" (OuterVolumeSpecName: "kube-api-access-6k4cj") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "kube-api-access-6k4cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:41:02.490665 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.490615    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83460b40-02be-40e1-a1f6-2864860067b7" (UID: "83460b40-02be-40e1-a1f6-2864860067b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:41:02.589477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.589440    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k4cj\" (UniqueName: \"kubernetes.io/projected/83460b40-02be-40e1-a1f6-2864860067b7-kube-api-access-6k4cj\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.589477 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.589476    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83460b40-02be-40e1-a1f6-2864860067b7-tls-certs\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.589802 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.589489    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-dshm\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.589802 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.589520    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-tmp-dir\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.589802 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.589533    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83460b40-02be-40e1-a1f6-2864860067b7-model-cache\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:41:02.674918 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.674879    2562 generic.go:356] "Generic (PLEG): container finished" podID="83460b40-02be-40e1-a1f6-2864860067b7" containerID="7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9" exitCode=0
Jul 07 20:41:02.674918 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.674915    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"
Jul 07 20:41:02.675119 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.674945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" event={"ID":"83460b40-02be-40e1-a1f6-2864860067b7","Type":"ContainerDied","Data":"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"}
Jul 07 20:41:02.675119 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.674980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6" event={"ID":"83460b40-02be-40e1-a1f6-2864860067b7","Type":"ContainerDied","Data":"e6af1b83c94e23ef96e766ba3630b654a02cd3e67262066e2e29f047d9cfafb0"}
Jul 07 20:41:02.675119 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.674999    2562 scope.go:117] "RemoveContainer" containerID="7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"
Jul 07 20:41:02.684545 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.684526    2562 scope.go:117] "RemoveContainer" containerID="7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"
Jul 07 20:41:02.684845 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:41:02.684822    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9\": container with ID starting with 7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9 not found: ID does not exist" containerID="7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"
Jul 07 20:41:02.684919 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.684856    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9"} err="failed to get container status \"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9\": rpc error: code = NotFound desc = could not find container \"7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9\": container with ID starting with 7511918c3dc7772dbc1fab6a653abf3ce696c041b93e0f555ec14bedd483d3f9 not found: ID does not exist"
Jul 07 20:41:02.698314 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.698281    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:41:02.704223 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:02.704159    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/sub-test-model-e9f8cf-kserve-5dbbd6569c-kbdx6"]
Jul 07 20:41:03.585337 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:03.585293    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83460b40-02be-40e1-a1f6-2864860067b7" path="/var/lib/kubelet/pods/83460b40-02be-40e1-a1f6-2864860067b7/volumes"
Jul 07 20:41:05.089746 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:05.089706    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:41:05.090167 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:05.089774    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:41:05.102392 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:05.102365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:41:05.702245 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:05.702211    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:41:33.536309 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:33.536231    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:41:47.332061 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:41:47.332019    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:42:01.625373 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:01.625333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:42:07.380437 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:07.380396    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:42:13.832652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:13.832619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:42:22.399672 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.399625    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" podUID="f68b917a-ca64-4aef-920b-548a269968fe" containerName="main" containerID="cri-o://e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344" gracePeriod=45
Jul 07 20:42:22.644348 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.644321    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:42:22.775623 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775578    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2wm\" (UniqueName: \"kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775706    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775734    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775785 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775986 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir\") pod \"f68b917a-ca64-4aef-920b-548a269968fe\" (UID: \"f68b917a-ca64-4aef-920b-548a269968fe\") "
Jul 07 20:42:22.775986 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775968    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home" (OuterVolumeSpecName: "home") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:42:22.776192 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.775976    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:42:22.776192 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.776064    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-model-cache\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:22.776192 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.776085    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-home\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:22.776192 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.776168    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:42:22.777751 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.777726    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 20:42:22.777894 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.777879    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm" (OuterVolumeSpecName: "dshm") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 20:42:22.778030 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.778014    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm" (OuterVolumeSpecName: "kube-api-access-jg2wm") pod "f68b917a-ca64-4aef-920b-548a269968fe" (UID: "f68b917a-ca64-4aef-920b-548a269968fe"). InnerVolumeSpecName "kube-api-access-jg2wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 20:42:22.877025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.876991    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-dshm\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:22.877025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.877019    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68b917a-ca64-4aef-920b-548a269968fe-tmp-dir\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:22.877025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.877030    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2wm\" (UniqueName: \"kubernetes.io/projected/f68b917a-ca64-4aef-920b-548a269968fe-kube-api-access-jg2wm\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:22.877255 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:22.877040    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68b917a-ca64-4aef-920b-548a269968fe-tls-certs\") on node \"ip-10-0-134-113.ec2.internal\" DevicePath \"\""
Jul 07 20:42:23.022472 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.022440    2562 generic.go:356] "Generic (PLEG): container finished" podID="f68b917a-ca64-4aef-920b-548a269968fe" containerID="e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344" exitCode=0
Jul 07 20:42:23.022652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.022485    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"
Jul 07 20:42:23.022652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.022490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" event={"ID":"f68b917a-ca64-4aef-920b-548a269968fe","Type":"ContainerDied","Data":"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"}
Jul 07 20:42:23.022652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.022581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl" event={"ID":"f68b917a-ca64-4aef-920b-548a269968fe","Type":"ContainerDied","Data":"aeff4d7d31691791b2ac232a5b1ea257579dcc274bf74b5f530d9af5decbcdb0"}
Jul 07 20:42:23.022652 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.022609    2562 scope.go:117] "RemoveContainer" containerID="e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"
Jul 07 20:42:23.031391 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.031373    2562 scope.go:117] "RemoveContainer" containerID="e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"
Jul 07 20:42:23.031691 ip-10-0-134-113 kubenswrapper[2562]: E0707 20:42:23.031672    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344\": container with ID starting with e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344 not found: ID does not exist" containerID="e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"
Jul 07 20:42:23.031773 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.031700    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344"} err="failed to get container status \"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344\": rpc error: code = NotFound desc = could not find container \"e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344\": container with ID starting with e966ac73173ef9c619d52c461366ae21aecd92e19cedcf42bdb5b86073542344 not found: ID does not exist"
Jul 07 20:42:23.045081 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.045058    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:42:23.049219 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.049201    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9f8cf/rate-test-model-e9f8cf-kserve-bc7f6cbb7-r8xrl"]
Jul 07 20:42:23.591369 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:23.591336    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f68b917a-ca64-4aef-920b-548a269968fe" path="/var/lib/kubelet/pods/f68b917a-ca64-4aef-920b-548a269968fe/volumes"
Jul 07 20:42:56.236000 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:42:56.235960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8ckdz"]
Jul 07 20:43:06.346738 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:06.346664    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b6c875b7-vgq8h_2f2e2236-3ee8-4060-82a9-deabc18ca483/manager/0.log"
Jul 07 20:43:06.453440 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:06.453411    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t2rcx_f5400ae9-784b-47e3-ae18-b3a09c756d38/server/0.log"
Jul 07 20:43:06.575128 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:06.575095    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kdgsf_9555ccd4-5ce8-4084-ada7-5073bbaf1b69/manager/0.log"
Jul 07 20:43:06.704372 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:06.704290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-659495cbcb-p46hb_8ea441a9-1241-456f-bb0e-3922683c34d9/copy-manifests/0.log"
Jul 07 20:43:06.717662 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:06.717631    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-659495cbcb-p46hb_8ea441a9-1241-456f-bb0e-3922683c34d9/manager/0.log"
Jul 07 20:43:07.087742 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:07.087715    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jz7vr_4ed07ca6-b12e-42ae-8ccc-f910ac122fca/postgres/0.log"
Jul 07 20:43:08.728268 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:08.728239    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6hmw4_c020ec86-188d-48c9-84e9-02f03a941865/manager/0.log"
Jul 07 20:43:08.972151 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:08.972121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kzszn_97f0ea9d-3b07-4d67-9bb8-bca7db81349b/registry-server/0.log"
Jul 07 20:43:09.103879 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:09.103849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z8lqc_6348adf0-b9fa-4d29-ba8e-b6b85286d4b7/manager/0.log"
Jul 07 20:43:09.223396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:09.223371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8ckdz_c48f3a66-f401-4947-ace7-a894f8084869/limitador/0.log"
Jul 07 20:43:09.856252 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:09.856221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nkvzc_3079440c-3302-42e1-ac04-71a9a57f9d01/discovery/0.log"
Jul 07 20:43:10.099812 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:10.099783    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68f4c445fc-b5t6b_e58eb782-8c52-473e-a0f1-1910f832d61f/kube-auth-proxy/0.log"
Jul 07 20:43:10.506054 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:10.506025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n86dc_13322a9a-5ed0-4fd3-b989-f5618608e877/payload-processing/0.log"
Jul 07 20:43:11.505497 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:11.505466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vbnmz_108677dc-9959-41ca-ad2e-fe0d186e468a/main/0.log"
Jul 07 20:43:19.870755 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:19.870726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ss8j7_31f67891-abed-4ca5-b2d1-1c4a7e3b5516/global-pull-secret-syncer/0.log"
Jul 07 20:43:20.038456 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:20.038424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lhg64_194dcf45-e49c-40c5-954a-aeb1f7c29a45/konnectivity-agent/0.log"
Jul 07 20:43:20.110736 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:20.110711    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-113.ec2.internal_66d40220305fe03479bbe46175f2cd79/haproxy/0.log"
Jul 07 20:43:25.737124 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:25.737094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6hmw4_c020ec86-188d-48c9-84e9-02f03a941865/manager/0.log"
Jul 07 20:43:25.813154 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:25.813125    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kzszn_97f0ea9d-3b07-4d67-9bb8-bca7db81349b/registry-server/0.log"
Jul 07 20:43:25.956574 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:25.956538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z8lqc_6348adf0-b9fa-4d29-ba8e-b6b85286d4b7/manager/0.log"
Jul 07 20:43:25.988736 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:25.988653    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8ckdz_c48f3a66-f401-4947-ace7-a894f8084869/limitador/0.log"
Jul 07 20:43:28.250173 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:28.250149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msvc2_6e11c08f-d26a-4c15-b9ee-e9225b3f36db/node-exporter/0.log"
Jul 07 20:43:28.275451 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:28.275431    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msvc2_6e11c08f-d26a-4c15-b9ee-e9225b3f36db/kube-rbac-proxy/0.log"
Jul 07 20:43:28.299025 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:28.299002    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msvc2_6e11c08f-d26a-4c15-b9ee-e9225b3f36db/init-textfile/0.log"
Jul 07 20:43:29.986571 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986537    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"]
Jul 07 20:43:29.986932 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986875    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83460b40-02be-40e1-a1f6-2864860067b7" containerName="main"
Jul 07 20:43:29.986932 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986887    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="83460b40-02be-40e1-a1f6-2864860067b7" containerName="main"
Jul 07 20:43:29.986932 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986900    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f68b917a-ca64-4aef-920b-548a269968fe" containerName="main"
Jul 07 20:43:29.986932 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986905    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f68b917a-ca64-4aef-920b-548a269968fe" containerName="main"
Jul 07 20:43:29.987061 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986984    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f68b917a-ca64-4aef-920b-548a269968fe" containerName="main"
Jul 07 20:43:29.987061 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.986992    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="83460b40-02be-40e1-a1f6-2864860067b7" containerName="main"
Jul 07 20:43:29.992974 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.991102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:29.995000 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.994963    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ww672\"/\"default-dockercfg-k44j8\""
Jul 07 20:43:29.995000 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.994967    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ww672\"/\"kube-root-ca.crt\""
Jul 07 20:43:29.995986 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.995968    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ww672\"/\"openshift-service-ca.crt\""
Jul 07 20:43:29.998829 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:29.998809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"]
Jul 07 20:43:30.105961 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.105928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8b9g\" (UniqueName: \"kubernetes.io/projected/57b62571-a47f-4c03-8e30-f4d835980197-kube-api-access-g8b9g\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.105961 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.105962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-sys\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.106163 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.105994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-podres\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.106163 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.106055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-lib-modules\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.106163 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.106122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-proc\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207001 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.206973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-proc\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8b9g\" (UniqueName: \"kubernetes.io/projected/57b62571-a47f-4c03-8e30-f4d835980197-kube-api-access-g8b9g\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-sys\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-podres\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-lib-modules\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207108    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-proc\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207178 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-sys\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207430 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207280    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-podres\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.207430 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.207308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57b62571-a47f-4c03-8e30-f4d835980197-lib-modules\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.216460 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.216437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8b9g\" (UniqueName: \"kubernetes.io/projected/57b62571-a47f-4c03-8e30-f4d835980197-kube-api-access-g8b9g\") pod \"perf-node-gather-daemonset-xfj6c\" (UID: \"57b62571-a47f-4c03-8e30-f4d835980197\") " pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.303024 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.302994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:30.431250 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:30.431223    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"]
Jul 07 20:43:30.433795 ip-10-0-134-113 kubenswrapper[2562]: W0707 20:43:30.433762    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod57b62571_a47f_4c03_8e30_f4d835980197.slice/crio-960929397fee29a5344fb11bc84c8d0b2d4874d6950c2c984396a617151e25b1 WatchSource:0}: Error finding container 960929397fee29a5344fb11bc84c8d0b2d4874d6950c2c984396a617151e25b1: Status 404 returned error can't find the container with id 960929397fee29a5344fb11bc84c8d0b2d4874d6950c2c984396a617151e25b1
Jul 07 20:43:31.313232 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:31.313190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c" event={"ID":"57b62571-a47f-4c03-8e30-f4d835980197","Type":"ContainerStarted","Data":"a10ac32afde998902604ea60b668db5dd8acd456412025836571841193f6d9ee"}
Jul 07 20:43:31.313657 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:31.313252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c" event={"ID":"57b62571-a47f-4c03-8e30-f4d835980197","Type":"ContainerStarted","Data":"960929397fee29a5344fb11bc84c8d0b2d4874d6950c2c984396a617151e25b1"}
Jul 07 20:43:31.313657 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:31.313324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:31.330873 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:31.330819    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c" podStartSLOduration=2.330803747 podStartE2EDuration="2.330803747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 20:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 20:43:31.329353835 +0000 UTC m=+2542.169850723" watchObservedRunningTime="2026-07-07 20:43:31.330803747 +0000 UTC m=+2542.171300624"
Jul 07 20:43:33.123233 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:33.123204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65qjr_d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6/dns/0.log"
Jul 07 20:43:33.146506 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:33.146479    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65qjr_d50cfc2c-6c24-4903-872b-6c8e6ef5a9d6/kube-rbac-proxy/0.log"
Jul 07 20:43:33.262012 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:33.261985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpgxw_c57dccef-fbed-4ee2-9852-9760f1285278/dns-node-resolver/0.log"
Jul 07 20:43:33.841824 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:33.841798    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-df479756f-rz5h9_4dfdb643-9e9e-46eb-ab0e-49df2c723e39/registry/0.log"
Jul 07 20:43:33.916803 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:33.916778    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mclb4_36955712-fb96-436a-b7ab-bc4bb2858822/node-ca/0.log"
Jul 07 20:43:35.010814 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:35.010786    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nkvzc_3079440c-3302-42e1-ac04-71a9a57f9d01/discovery/0.log"
Jul 07 20:43:35.059725 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:35.059697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68f4c445fc-b5t6b_e58eb782-8c52-473e-a0f1-1910f832d61f/kube-auth-proxy/0.log"
Jul 07 20:43:35.193077 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:35.193049    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n86dc_13322a9a-5ed0-4fd3-b989-f5618608e877/payload-processing/0.log"
Jul 07 20:43:35.968378 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:35.968350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mhgp_56431755-26ca-4a64-8d7a-703ae2b2cc4a/serve-healthcheck-canary/0.log"
Jul 07 20:43:36.657468 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:36.657436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9pmf_aa947f06-5290-44ae-899d-7ae553c9b2ec/kube-rbac-proxy/0.log"
Jul 07 20:43:36.679697 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:36.679671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9pmf_aa947f06-5290-44ae-899d-7ae553c9b2ec/exporter/0.log"
Jul 07 20:43:36.702358 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:36.702333    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9pmf_aa947f06-5290-44ae-899d-7ae553c9b2ec/extractor/0.log"
Jul 07 20:43:37.327622 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:37.327572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ww672/perf-node-gather-daemonset-xfj6c"
Jul 07 20:43:39.350789 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.350755    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b6c875b7-vgq8h_2f2e2236-3ee8-4060-82a9-deabc18ca483/manager/0.log"
Jul 07 20:43:39.374396 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.374366    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t2rcx_f5400ae9-784b-47e3-ae18-b3a09c756d38/server/0.log"
Jul 07 20:43:39.448433 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.448407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kdgsf_9555ccd4-5ce8-4084-ada7-5073bbaf1b69/manager/0.log"
Jul 07 20:43:39.519093 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.519064    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-659495cbcb-p46hb_8ea441a9-1241-456f-bb0e-3922683c34d9/manager/0.log"
Jul 07 20:43:39.536959 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.536936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-659495cbcb-p46hb_8ea441a9-1241-456f-bb0e-3922683c34d9/copy-manifests/0.log"
Jul 07 20:43:39.682044 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:39.682024    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jz7vr_4ed07ca6-b12e-42ae-8ccc-f910ac122fca/postgres/0.log"
Jul 07 20:43:40.459993 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:40.459916    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nkvzc_3079440c-3302-42e1-ac04-71a9a57f9d01/discovery/0.log"
Jul 07 20:43:40.491383 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:40.491356    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68f4c445fc-b5t6b_e58eb782-8c52-473e-a0f1-1910f832d61f/kube-auth-proxy/0.log"
Jul 07 20:43:40.605810 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:40.605780    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n86dc_13322a9a-5ed0-4fd3-b989-f5618608e877/payload-processing/0.log"
Jul 07 20:43:41.944519 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:41.944442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nkvzc_3079440c-3302-42e1-ac04-71a9a57f9d01/discovery/0.log"
Jul 07 20:43:41.975056 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:41.975030    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68f4c445fc-b5t6b_e58eb782-8c52-473e-a0f1-1910f832d61f/kube-auth-proxy/0.log"
Jul 07 20:43:42.100315 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:42.100267    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n86dc_13322a9a-5ed0-4fd3-b989-f5618608e877/payload-processing/0.log"
Jul 07 20:43:46.117707 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:46.117679    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-v2fkd_bdf692d3-7e81-4163-b366-70f795e09a6a/migrator/0.log"
Jul 07 20:43:46.143156 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:46.143127    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-v2fkd_bdf692d3-7e81-4163-b366-70f795e09a6a/graceful-termination/0.log"
Jul 07 20:43:47.649728 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.649702    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/kube-multus-additional-cni-plugins/0.log"
Jul 07 20:43:47.679666 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.679638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/egress-router-binary-copy/0.log"
Jul 07 20:43:47.710187 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.710163    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/cni-plugins/0.log"
Jul 07 20:43:47.733508 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.733484    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/bond-cni-plugin/0.log"
Jul 07 20:43:47.756470 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.756451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/routeoverride-cni/0.log"
Jul 07 20:43:47.780126 ip-10-0-134-113 kubenswrapper[2562]: I0707 20:43:47.780089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvmg4_9f91be0c-74f0-4df9-9b90-e8c82fad3f72/whereabouts-cni-bincopy/0.log"