Jul 12 14:41:13.005493 ip-10-0-139-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 14:41:13.369223 ip-10-0-139-143 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 14:41:13.369223 ip-10-0-139-143 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 14:41:13.369223 ip-10-0-139-143 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 14:41:13.369223 ip-10-0-139-143 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 14:41:13.369223 ip-10-0-139-143 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 14:41:13.370287 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.370145    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 14:41:13.378586 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378565    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.378586 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378586    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.378586 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378590    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378593    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378597    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378599    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378602    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378605    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378608    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378611    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378613    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378616    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378618    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378621    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378623    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378626    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378629    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378631    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378634    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378637    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378639    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378643    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.378701 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378645    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378648    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378651    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378653    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378656    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378658    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378661    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378663    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378666    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378668    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378671    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378673    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378676    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378679    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378682    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378685    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378688    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378690    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378696    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378698    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.379192 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378701    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378704    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378706    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378709    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378712    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378717    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378722    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378725    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378728    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378732    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378735    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378737    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378740    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378743    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378746    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378749    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378751    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378754    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378756    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378759    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.379691 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378762    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378764    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378767    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378770    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378772    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378775    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378788    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378791    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378795    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378799    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378803    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378806    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378809    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378812    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378815    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378817    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378820    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378823    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378825    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.380177 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378828    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378834    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378837    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378840    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378843    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378846    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378849    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378852    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378855    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378858    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378861    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378864    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378867    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378870    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378872    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378875    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378877    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.378880    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379630    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.380638 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379637    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379640    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379643    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379646    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379649    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379652    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379655    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379658    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379661    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379663    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379666    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379668    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379672    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379674    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379677    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379679    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379682    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379684    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379687    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379689    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.381180 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379692    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379695    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379698    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379700    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379705    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379709    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379712    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379715    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379718    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379721    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379724    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379727    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379730    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379733    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379736    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379739    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379745    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379747    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379750    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.381705 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379752    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379756    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379760    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379763    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379765    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379768    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379771    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379774    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379778    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379781    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379784    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379787    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379789    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379792    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379795    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379799    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379802    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379804    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379807    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.382183 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379809    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379812    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379814    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379817    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379819    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379822    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379825    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379828    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379831    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379833    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379835    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379838    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379840    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379843    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379845    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379848    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379851    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379854    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379857    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379859    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.382653 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379862    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379865    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379867    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379870    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379873    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379875    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379878    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379880    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379883    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379885    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379888    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379890    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379893    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379895    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379897    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379900    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379902    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379905    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379908    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.379911    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.383148 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380359    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380366    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380369    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380372    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380376    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380378    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380381    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380384    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380387    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380389    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380392    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380395    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380398    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380401    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380405    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380409    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380412    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380414    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380417    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.383632 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380420    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380422    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380425    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380427    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380430    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380432    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380435    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380437    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380440    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380442    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380445    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380450    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380452    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380455    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380457    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380460    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380463    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380465    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380468    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380471    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380473    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.384076 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380476    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380478    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380481    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380483    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380486    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380490    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380492    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380495    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380498    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380500    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380502    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380505    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380508    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380510    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380513    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380515    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380518    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380520    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380523    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.384593 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380526    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380528    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380531    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380535    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380537    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380540    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380543    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380546    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380550    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380554    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380556    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380559    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380570    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380573    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380576    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380578    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380581    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380584    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380586    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.385086 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380590    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380593    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380595    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380598    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380600    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380603    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380605    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380609    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380613    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380616    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380620    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380623    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380626    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380629    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380631    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380634    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380638    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380640    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380643    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.385563 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380646    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.380649    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380722    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380730    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380737    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380742    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380746    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380749    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380754    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380758    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380762    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380765    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380770    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380774    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380777    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380780    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380783    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380786    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380789    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380793    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380797    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380800    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380803    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380806    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 14:41:13.386012 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380810    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380814    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380817    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380820    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380823    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380829    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380832    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380835    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380838    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380841    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380845    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380848    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380851    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380854    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380857    2581 flags.go:64] FLAG: --enable-server="true"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380860    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380865    2581 flags.go:64] FLAG: --event-burst="100"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380868    2581 flags.go:64] FLAG: --event-qps="50"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380871    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380874    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380879    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380883    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380886    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380889    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380893    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 12 14:41:13.386586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380895    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380898    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380901    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380904    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380907    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380910    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380913    2581 flags.go:64] FLAG: --feature-gates=""
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380917    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380920    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380923    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380927    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380930    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380934    2581 flags.go:64] FLAG: --help="false"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380937    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380940    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380943    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380946    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380949    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380953    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380955    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380958    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380961    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380964    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 14:41:13.387231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380967    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380972    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380977    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380981    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380986    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380989    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380993    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380995    2581 flags.go:64] FLAG: --lock-file=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.380999    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381002    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381005    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381011    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381013    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381016    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381019    2581 flags.go:64] FLAG: --logging-format="text"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381022    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381025    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381028    2581 flags.go:64] FLAG: --manifest-url=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381031    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381036    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381039    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381045    2581 flags.go:64] FLAG: --max-pods="110"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381048    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381051    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381053    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 14:41:13.387822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381056    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381059    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381062    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381065    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381074    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381077    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381081    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381084    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381086    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381093    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381096    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381100    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381103    2581 flags.go:64] FLAG: --port="10250"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381106    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381109    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01cec8e618582b34f"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381112    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381116    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381119    2581 flags.go:64] FLAG: --register-node="true"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381136    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381147    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381150    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381153    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381156    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381160    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381163    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 14:41:13.388447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381166    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381169    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381172    2581 flags.go:64] FLAG: --runonce="false"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381175    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381180    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381183    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381186    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381189    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381193    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381196    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381199    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381203    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381206    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381209    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381211    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381214    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381217    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381220    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381227    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381230    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381233    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381237    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381240    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381243    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381247    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 14:41:13.389054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381250    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381252    2581 flags.go:64] FLAG: --v="2"
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381256    2581 flags.go:64] FLAG: --version="false"
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381261    2581 flags.go:64] FLAG: --vmodule=""
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381264    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381268    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381389    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381392    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381395    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381398    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381401    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381405    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381408    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381411    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381414    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381416    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381419    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381421    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381424    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381427    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381429    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.389678 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381432    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381435    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381437    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381440    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381444    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381447    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381449    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381452    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381455    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381458    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381461    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381464    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381466    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381469    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381471    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381474    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381476    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381478    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381481    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381483    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.390212 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381486    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381489    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381493    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381495    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381498    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381500    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381503    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381506    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381509    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381511    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381514    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381516    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381519    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381522    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381525    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381527    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381531    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381534    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381537    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381539    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.390728 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381541    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381544    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381546    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381549    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381552    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381555    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381557    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381560    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381562    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381565    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381567    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381569    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381572    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381575    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381578    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381581    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381583    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381586    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381588    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.391248 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381591    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381595    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381599    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381602    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381604    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381607    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381610    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381612    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381615    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381619    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381621    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381624    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381627    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381629    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381632    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381636    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381639    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381642    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.391709 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381647    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381651    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381654    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381657    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381660    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381663    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.381666    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.381674    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.388695    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.388713    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.388737    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.388744    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388801    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388806    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.392162 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388810    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388813    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388816    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388819    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388821    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388824    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388827    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388829    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388832    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388835    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388837    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388840    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388843    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388845    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388848    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388851    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388853    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388856    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388859    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.392521 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388862    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388864    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388867    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388869    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388872    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388874    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388877    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388880    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388885    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388888    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388891    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388893    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388896    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388899    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388901    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388904    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388906    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388909    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388911    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388914    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.392992 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388917    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388919    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388922    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388924    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388927    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388932    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388936    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388939    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388942    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388945    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388947    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388950    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388954    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388957    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388960    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388963    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388966    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388968    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.393484 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388972    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388975    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388978    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388982    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388985    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388987    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388990    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388992    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388995    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.388997    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389000    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389003    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389006    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389008    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389010    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389013    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389016    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389018    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389021    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389024    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.393923 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389027    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389030    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389033    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389036    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389039    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389041    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389044    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389046    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389049    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389052    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389054    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389057    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389060    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389064    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389067    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389070    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389073    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389076    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389079    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.394413 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389081    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.389087    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389218    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389223    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389226    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389229    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389232    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389235    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389237    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389240    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389242    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389265    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389268    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389272    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 14:41:13.394884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389276    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389281    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389284    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389287    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389290    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389294    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389296    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389299    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389302    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389304    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389307    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389310    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389312    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389315    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389318    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389321    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389324    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389327    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389330    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389332    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 14:41:13.395374 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389335    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389337    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389340    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389343    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389345    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389348    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389351    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389353    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389356    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389358    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389361    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389363    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389366    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389368    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389371    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389374    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389376    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389379    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389381    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389384    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 14:41:13.396019 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389387    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389390    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389392    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389394    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389397    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389400    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389402    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389405    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389408    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389412    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389415    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389417    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389420    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389424    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389427    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389430    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389433    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389436    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389438    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389441    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 14:41:13.396798 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389444    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389447    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389449    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389452    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389454    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389457    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389459    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389463    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389466    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389469    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389471    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389474    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389477    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389479    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389482    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389484    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389486    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389489    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389492    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389495    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 14:41:13.397367 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389497    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389500    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389503    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389505    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389508    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389510    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:13.389513    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.389517    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.389643    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.391837    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.393178    2581 server.go:1019] "Starting client certificate rotation"
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.393277    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.393317    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 14:41:13.397840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.396280    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 14:41:13.400587 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.400570    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 14:41:13.407652 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.407633    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 12 14:41:13.412065 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.412044    2581 log.go:25] "Validated CRI v1 image API"
Jul 12 14:41:13.413536 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.413521    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 14:41:13.415895 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.415873    2581 fs.go:135] Filesystem UUIDs: map[36f76eca-0004-43c3-993c-45f091c0d30e:/dev/nvme0n1p3 5390f048-9566-4b8b-8c34-6a7638072c21:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 12 14:41:13.415975 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.415893    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 14:41:13.421274 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.421092    2581 manager.go:216] Machine: {Timestamp:2026-07-12 14:41:13.41966353 +0000 UTC m=+0.309808306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097186 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3f1fed3fadf8f8d78abcd3e14617 SystemUUID:ec2c3f1f-ed3f-adf8-f8d7-8abcd3e14617 BootID:49ba5618-9bab-42da-a876-7bdf85e90c41 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:1e:ef:31:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:1e:ef:31:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:d8:ab:24:c6:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 14:41:13.421274 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.421274    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 14:41:13.421435 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.421369    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 14:41:13.423848 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.423832    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 14:41:13.424346 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.424319    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 14:41:13.424499 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.424349    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 14:41:13.425195 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.425183    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 14:41:13.425235 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.425198    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 14:41:13.425235 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.425210    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 14:41:13.425879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.425867    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 14:41:13.427545 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.427535    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 14:41:13.430641 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430627    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 14:41:13.430771 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430761    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 14:41:13.430801 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430794    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 14:41:13.430831 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430810    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 14:41:13.430831 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430830    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 14:41:13.430884 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430843    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 12 14:41:13.430884 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.430857    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 14:41:13.431324 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.431311    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 14:41:13.431384 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.431330    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 14:41:13.433402 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.433387    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 14:41:13.435638 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.435625    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 14:41:13.435677 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.435655    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 14:41:13.436462 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436450    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 14:41:13.436502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436471    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 14:41:13.436502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436478    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 14:41:13.436502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436483    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 14:41:13.436502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436491    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 14:41:13.436502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436498    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436506    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436511    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436517    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436530    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436542    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 14:41:13.436646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.436547    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 14:41:13.437304 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.437295    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 14:41:13.437337 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.437306    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 14:41:13.441509 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.441492    2581 server.go:1268] "Started kubelet"
Jul 12 14:41:13.441858 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.441571    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 14:41:13.442154 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.441578    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 14:41:13.442236 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.442177    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 14:41:13.442511 ip-10-0-139-143 systemd[1]: Started Kubernetes Kubelet.
Jul 12 14:41:13.442634 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.442509    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 14:41:13.442723 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.442676    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 14:41:13.442723 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.442706    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 14:41:13.443663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.443642    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 14:41:13.443932 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.443918    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 14:41:13.447619 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.446734    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-143.ec2.internal.18c191d577ec2df0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-143.ec2.internal,UID:ip-10-0-139-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-143.ec2.internal,},FirstTimestamp:2026-07-12 14:41:13.4414556 +0000 UTC m=+0.331600376,LastTimestamp:2026-07-12 14:41:13.4414556 +0000 UTC m=+0.331600376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-143.ec2.internal,}"
Jul 12 14:41:13.447758 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.447742    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 14:41:13.449739 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.449720    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 14:41:13.449739 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.449732    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 14:41:13.449898 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.449815    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.450382 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450360    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 14:41:13.450481 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450368    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 14:41:13.450481 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450405    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 14:41:13.450564 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450509    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 14:41:13.450564 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450518    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 14:41:13.450691 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450679    2581 factory.go:55] Registering systemd factory
Jul 12 14:41:13.450750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450696    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 12 14:41:13.450926 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450906    2581 factory.go:153] Registering CRI-O factory
Jul 12 14:41:13.451006 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.450924    2581 factory.go:223] Registration of the crio container factory successfully
Jul 12 14:41:13.451060 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.451014    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 14:41:13.451060 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.451038    2581 factory.go:103] Registering Raw factory
Jul 12 14:41:13.451060 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.451053    2581 manager.go:1196] Started watching for new ooms in manager
Jul 12 14:41:13.451692 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.451679    2581 manager.go:349] Starting recovery of all containers
Jul 12 14:41:13.453840 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.453817    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plzwp"
Jul 12 14:41:13.455550 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.455512    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 14:41:13.455647 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.455542    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 14:41:13.457972 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.457949    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 14:41:13.462202 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.462178    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plzwp"
Jul 12 14:41:13.464932 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.464713    2581 manager.go:354] Recovery completed
Jul 12 14:41:13.467452 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.467434    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 12 14:41:13.470552 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.470540    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.472578 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.472551    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.472659 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.472591    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.472659 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.472601    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.473139 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473113    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 14:41:13.473200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473140    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 14:41:13.473200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473158    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 14:41:13.473200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473163    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.473836 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473820    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.473905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473851    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.473905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.473865    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.474234 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.474222    2581 policy_none.go:49] "None policy: Start"
Jul 12 14:41:13.474277 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.474237    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 14:41:13.474277 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.474248    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 14:41:13.474785 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.474691    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-143.ec2.internal.18c191d579c70ff6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-143.ec2.internal,UID:ip-10-0-139-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-143.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-143.ec2.internal,},FirstTimestamp:2026-07-12 14:41:13.472577526 +0000 UTC m=+0.362722302,LastTimestamp:2026-07-12 14:41:13.472577526 +0000 UTC m=+0.362722302,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-143.ec2.internal,}"
Jul 12 14:41:13.475285 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.475274    2581 policy_none.go:47] "Start"
Jul 12 14:41:13.524942 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.524920    2581 manager.go:337] "Starting Device Plugin manager"
Jul 12 14:41:13.525056 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.524963    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 14:41:13.525056 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.524978    2581 server.go:87] "Starting device plugin registration server"
Jul 12 14:41:13.525352 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.525335    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 14:41:13.525423 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.525353    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 14:41:13.525502 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.525462    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 14:41:13.525619 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.525592    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 14:41:13.525619 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.525609    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 14:41:13.526213 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.526192    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 14:41:13.526303 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.526252    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.604859 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.604824    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 14:41:13.605919 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.604878    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 14:41:13.605919 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.604910    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 14:41:13.605919 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.604956    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 14:41:13.607614 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.607594    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 14:41:13.626182 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.626109    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.627394 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.627376    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.627469 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.627410    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.627469 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.627420    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.627469 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.627447    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.634431 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.634411    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.634532 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.634442    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-143.ec2.internal\": node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.646318 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.646292    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.706657 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.706619    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"]
Jul 12 14:41:13.706830 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.706722    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.708573 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.708553    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.708685 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.708590    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.708685 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.708600    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.709955 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.709941    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.710111 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.710261 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710128    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.710726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710707    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.710805 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710736    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.710805 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710771    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.710906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710710    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.710906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710833    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.710906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.710851    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.712225 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.712210    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.712306 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.712242    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 14:41:13.713067 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.713041    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 14:41:13.713146 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.713069    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 14:41:13.713146 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.713081    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeHasSufficientPID"
Jul 12 14:41:13.737092 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.737067    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-143.ec2.internal\" not found" node="ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.741915 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.741896    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-143.ec2.internal\" not found" node="ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.747053 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.747037    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.752580 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.752550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.752675 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.752587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.752675 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.752605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fdfd063a846aba40894375a4d9f448c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-143.ec2.internal\" (UID: \"8fdfd063a846aba40894375a4d9f448c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.847708 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.847662    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:13.853528 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.853646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.853646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.853646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fdfd063a846aba40894375a4d9f448c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-143.ec2.internal\" (UID: \"8fdfd063a846aba40894375a4d9f448c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.853646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fdfd063a846aba40894375a4d9f448c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-143.ec2.internal\" (UID: \"8fdfd063a846aba40894375a4d9f448c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.853785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:13.853663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4dfe26b9aba197acf72330bd8b23093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal\" (UID: \"f4dfe26b9aba197acf72330bd8b23093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:13.948070 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:13.947978    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.045897 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.045846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:14.045897 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.045867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:14.048102 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.048085    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.153836 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.153791    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.257093 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.257002    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.358221 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.358184    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.394066 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.394026    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 14:41:14.394697 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.394223    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 14:41:14.458420 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.458380    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.465924 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.465874    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 14:36:13 +0000 UTC" deadline="2028-04-22 19:27:02.494687408 +0000 UTC"
Jul 12 14:41:14.465924 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.465915    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15604h45m48.028775947s"
Jul 12 14:41:14.553523 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.553457    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 14:41:14.558560 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.558529    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.602303 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:14.602265    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dfe26b9aba197acf72330bd8b23093.slice/crio-e5baaf090a752587dd11de4bb46b17fd086a4e804220e8dc1c29236d3fcb32ad WatchSource:0}: Error finding container e5baaf090a752587dd11de4bb46b17fd086a4e804220e8dc1c29236d3fcb32ad: Status 404 returned error can't find the container with id e5baaf090a752587dd11de4bb46b17fd086a4e804220e8dc1c29236d3fcb32ad
Jul 12 14:41:14.605447 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:14.605418    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fdfd063a846aba40894375a4d9f448c.slice/crio-8f32aea756e5a2691b71ecf5a037890914ed538a3179cab95b68f6bd4d8e6e11 WatchSource:0}: Error finding container 8f32aea756e5a2691b71ecf5a037890914ed538a3179cab95b68f6bd4d8e6e11: Status 404 returned error can't find the container with id 8f32aea756e5a2691b71ecf5a037890914ed538a3179cab95b68f6bd4d8e6e11
Jul 12 14:41:14.606918 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.606900    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 14:41:14.608676 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.608632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal" event={"ID":"8fdfd063a846aba40894375a4d9f448c","Type":"ContainerStarted","Data":"8f32aea756e5a2691b71ecf5a037890914ed538a3179cab95b68f6bd4d8e6e11"}
Jul 12 14:41:14.609907 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.609875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal" event={"ID":"f4dfe26b9aba197acf72330bd8b23093","Type":"ContainerStarted","Data":"e5baaf090a752587dd11de4bb46b17fd086a4e804220e8dc1c29236d3fcb32ad"}
Jul 12 14:41:14.659092 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.659048    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.759275 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.759237    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.783212 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.783188    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 14:41:14.859610 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:14.859515    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-143.ec2.internal\" not found"
Jul 12 14:41:14.921412 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.921380    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 14:41:14.950748 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.950699    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:14.962052 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.962026    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 14:41:14.963106 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.963092    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal"
Jul 12 14:41:14.969439 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:14.969414    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 14:41:15.432227 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.432195    2581 apiserver.go:52] "Watching apiserver"
Jul 12 14:41:15.441508 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.441473    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 14:41:15.441888 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.441859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bmzdc","kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm","openshift-cluster-node-tuning-operator/tuned-6fzfj","openshift-multus/multus-fbz8c","openshift-network-diagnostics/network-check-target-hblh4","openshift-ovn-kubernetes/ovnkube-node-mxvdz","openshift-dns/node-resolver-ddz4m","openshift-image-registry/node-ca-6f4b6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal","openshift-multus/multus-additional-cni-plugins-s4bg9","openshift-multus/network-metrics-daemon-q4pl4","openshift-network-operator/iptables-alerter-nnklb","kube-system/global-pull-secret-syncer-qhb57"]
Jul 12 14:41:15.443752 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.443688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.445240 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.445217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.445992 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.445672    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.446550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446104    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 14:41:15.446550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 14:41:15.446550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446298    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tzb47\""
Jul 12 14:41:15.446550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.446798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 14:41:15.447584 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.446993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.447584 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.447015    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 14:41:15.448712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.447892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 14:41:15.448712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.447958    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 14:41:15.448712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.448192    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d2bmg\""
Jul 12 14:41:15.448712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.448293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.449141 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.449120    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-twmxl\""
Jul 12 14:41:15.449244 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.449183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.449427 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.449402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 14:41:15.449650 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.449593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.450054 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.450036    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.450367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.450345    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.450972 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.450540    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f9fwp\""
Jul 12 14:41:15.450972 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.450888    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 14:41:15.451228 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.451190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.452419 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.452110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:15.452419 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.452251    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:15.453425 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.453404    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cl7qk\""
Jul 12 14:41:15.454106 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.453742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.454106 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.453811    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:15.454106 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.453818    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.457524 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.457501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.458182 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.458059    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.459517 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.459473    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.460442 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.459753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.460442 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.460108    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 14:41:15.460442 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.460126    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 14:41:15.460442 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.460348    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.460690 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.460568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gkq5t\""
Jul 12 14:41:15.461175 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.461158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.462092 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.462415 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462341    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 14:41:15.462521 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462428    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7k6p\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462720    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462784    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.462978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-kubernetes\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-run\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fr48\" (UniqueName: \"kubernetes.io/projected/68de21e2-4f82-4470-b615-94d403406a30-kube-api-access-5fr48\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463053    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-socket-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-conf\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-systemd\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-tuned\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-systemd-units\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-sys-fs\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-tmp\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-etc-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-ovn\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-node-log\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-konnectivity-ca\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-device-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463404    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-kubelet\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k6rgx\""
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-netns\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-log-socket\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-netd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-config\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysconfig\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-lib-modules\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.463879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb6dw\" (UniqueName: \"kubernetes.io/projected/b1e6febf-d5cc-470f-98aa-078dd955bc2d-kube-api-access-xb6dw\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-systemd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-var-lib-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-env-overrides\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-agent-certs\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-host\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e72614-2f15-488e-809c-9c6cf457b196-tmp-dir\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-slash\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.463992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-registration-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-modprobe-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-var-lib-kubelet\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p79vz\" (UniqueName: \"kubernetes.io/projected/51e72614-2f15-488e-809c-9c6cf457b196-kube-api-access-p79vz\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.464785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-script-lib\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jhj\" (UniqueName: \"kubernetes.io/projected/29880605-576e-453a-8e7c-41d2f91902a2-kube-api-access-j7jhj\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-sys\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e72614-2f15-488e-809c-9c6cf457b196-hosts-file\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-bin\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68de21e2-4f82-4470-b615-94d403406a30-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.465607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.464341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.466036 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.465928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.468666 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.466098    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:15.473586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.471345    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 14:41:15.473586 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.471660    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ckrwc\""
Jul 12 14:41:15.494119 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.494088    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zd2fj"
Jul 12 14:41:15.502587 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.502559    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zd2fj"
Jul 12 14:41:15.552172 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.552147    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 14:41:15.565016 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.564986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxr8\" (UniqueName: \"kubernetes.io/projected/45d028c1-3064-40db-9cdc-a0063eae53d4-kube-api-access-fsxr8\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.565176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-kubernetes\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.565176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-socket-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.565176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.565176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-k8s-cni-cncf-io\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-systemd\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-socket-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-kubernetes\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-node-log\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-node-log\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-konnectivity-ca\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-systemd\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-device-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.565422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee634728-10e6-46d5-987c-9a9f28873e67-serviceca\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-multus\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swctb\" (UniqueName: \"kubernetes.io/projected/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-kube-api-access-swctb\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00e48021-2e87-4326-916c-e6fa5430a8d5-host-slash\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tf4x\" (UniqueName: \"kubernetes.io/projected/00e48021-2e87-4326-916c-e6fa5430a8d5-kube-api-access-9tf4x\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-log-socket\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-kubelet-config\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cnibin\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-netns\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysconfig\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-lib-modules\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-systemd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-var-lib-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-env-overrides\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-agent-certs\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.566115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-slash\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-konnectivity-ca\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.565991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jhj\" (UniqueName: \"kubernetes.io/projected/29880605-576e-453a-8e7c-41d2f91902a2-kube-api-access-j7jhj\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-socket-dir-parent\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysconfig\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-device-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-modprobe-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p79vz\" (UniqueName: \"kubernetes.io/projected/51e72614-2f15-488e-809c-9c6cf457b196-kube-api-access-p79vz\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-system-cni-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-conf-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e72614-2f15-488e-809c-9c6cf457b196-hosts-file\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-modprobe-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-bin\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68de21e2-4f82-4470-b615-94d403406a30-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.566996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee634728-10e6-46d5-987c-9a9f28873e67-host\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-lib-modules\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-run\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-log-socket\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fr48\" (UniqueName: \"kubernetes.io/projected/68de21e2-4f82-4470-b615-94d403406a30-kube-api-access-5fr48\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-system-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cni-binary-copy\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-systemd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-conf\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-tuned\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-var-lib-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-systemd-units\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566536    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-systemd-units\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-sys-fs\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.567875 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cnibin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-tmp\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-etc-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-ovn\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-os-release\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51e72614-2f15-488e-809c-9c6cf457b196-hosts-file\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-etc-kubernetes\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-sys-fs\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-env-overrides\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.566984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-kubelet\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-kubelet\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-netns\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-run\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-bin\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.568794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-run-netns\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-netd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-config\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-daemon-config\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-etc-openvswitch\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-multus-certs\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-conf\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-cni-netd\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb6dw\" (UniqueName: \"kubernetes.io/projected/b1e6febf-d5cc-470f-98aa-078dd955bc2d-kube-api-access-xb6dw\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-run-ovn\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68de21e2-4f82-4470-b615-94d403406a30-host-slash\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-registration-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00e48021-2e87-4326-916c-e6fa5430a8d5-iptables-alerter-script\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-host\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e72614-2f15-488e-809c-9c6cf457b196-tmp-dir\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29880605-576e-453a-8e7c-41d2f91902a2-registration-dir\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.569750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-os-release\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hs6\" (UniqueName: \"kubernetes.io/projected/2d9f0db8-c95d-49de-bd7d-49d2207b6170-kube-api-access-s7hs6\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-hostroot\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-var-lib-kubelet\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-config\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-script-lib\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-var-lib-kubelet\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.567996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f85n\" (UniqueName: \"kubernetes.io/projected/ee634728-10e6-46d5-987c-9a9f28873e67-kube-api-access-6f85n\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-kubelet\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-sys\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568071    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e72614-2f15-488e-809c-9c6cf457b196-tmp-dir\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-sysctl-d\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-dbus\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-sys\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.570621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568154    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e6febf-d5cc-470f-98aa-078dd955bc2d-host\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-bin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.568605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68de21e2-4f82-4470-b615-94d403406a30-ovnkube-script-lib\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.571113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68de21e2-4f82-4470-b615-94d403406a30-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.571176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-tmp\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.571299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6-agent-certs\") pod \"konnectivity-agent-bmzdc\" (UID: \"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6\") " pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.571535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.571409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e6febf-d5cc-470f-98aa-078dd955bc2d-etc-tuned\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.575902 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.575735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p79vz\" (UniqueName: \"kubernetes.io/projected/51e72614-2f15-488e-809c-9c6cf457b196-kube-api-access-p79vz\") pod \"node-resolver-ddz4m\" (UID: \"51e72614-2f15-488e-809c-9c6cf457b196\") " pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.576286 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.576230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jhj\" (UniqueName: \"kubernetes.io/projected/29880605-576e-453a-8e7c-41d2f91902a2-kube-api-access-j7jhj\") pod \"aws-ebs-csi-driver-node-jbckm\" (UID: \"29880605-576e-453a-8e7c-41d2f91902a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.577544 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.577383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fr48\" (UniqueName: \"kubernetes.io/projected/68de21e2-4f82-4470-b615-94d403406a30-kube-api-access-5fr48\") pod \"ovnkube-node-mxvdz\" (UID: \"68de21e2-4f82-4470-b615-94d403406a30\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.577544 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.577412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb6dw\" (UniqueName: \"kubernetes.io/projected/b1e6febf-d5cc-470f-98aa-078dd955bc2d-kube-api-access-xb6dw\") pod \"tuned-6fzfj\" (UID: \"b1e6febf-d5cc-470f-98aa-078dd955bc2d\") " pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.669117 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:15.669117 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00e48021-2e87-4326-916c-e6fa5430a8d5-iptables-alerter-script\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-os-release\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hs6\" (UniqueName: \"kubernetes.io/projected/2d9f0db8-c95d-49de-bd7d-49d2207b6170-kube-api-access-s7hs6\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-hostroot\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f85n\" (UniqueName: \"kubernetes.io/projected/ee634728-10e6-46d5-987c-9a9f28873e67-kube-api-access-6f85n\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-os-release\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-kubelet\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.669381 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669384    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-kubelet\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-dbus\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-bin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.669454    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxr8\" (UniqueName: \"kubernetes.io/projected/45d028c1-3064-40db-9cdc-a0063eae53d4-kube-api-access-fsxr8\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.669522    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:16.169503013 +0000 UTC m=+3.059647782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-bin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-k8s-cni-cncf-io\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee634728-10e6-46d5-987c-9a9f28873e67-serviceca\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-multus\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swctb\" (UniqueName: \"kubernetes.io/projected/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-kube-api-access-swctb\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00e48021-2e87-4326-916c-e6fa5430a8d5-host-slash\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tf4x\" (UniqueName: \"kubernetes.io/projected/00e48021-2e87-4326-916c-e6fa5430a8d5-kube-api-access-9tf4x\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-kubelet-config\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.669835 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cnibin\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-netns\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-dbus\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-var-lib-cni-multus\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00e48021-2e87-4326-916c-e6fa5430a8d5-host-slash\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-socket-dir-parent\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cnibin\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-netns\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-hostroot\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00e48021-2e87-4326-916c-e6fa5430a8d5-iptables-alerter-script\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fa45f1-36ac-4043-beda-74d189b4d35b-kubelet-config\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.669736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-socket-dir-parent\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.670126    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-k8s-cni-cncf-io\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee634728-10e6-46d5-987c-9a9f28873e67-serviceca\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-system-cni-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.670674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.670195    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:16.17017822 +0000 UTC m=+3.060322988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9f0db8-c95d-49de-bd7d-49d2207b6170-system-cni-dir\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-conf-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-conf-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee634728-10e6-46d5-987c-9a9f28873e67-host\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-system-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cni-binary-copy\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee634728-10e6-46d5-987c-9a9f28873e67-host\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-system-cni-dir\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cnibin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-os-release\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-etc-kubernetes\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cnibin\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670586    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-etc-kubernetes\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.671498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-daemon-config\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-multus-certs\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-os-release\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-host-run-multus-certs\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.670966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-cni-binary-copy\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.671107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9f0db8-c95d-49de-bd7d-49d2207b6170-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.672189 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.671159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-multus-daemon-config\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.676017 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.675848    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:15.676017 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.675871    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:15.676017 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.675885    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:15.676017 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.675941    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 14:41:15.676017 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:15.675945    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:16.17592812 +0000 UTC m=+3.066072892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:15.678686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.678662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tf4x\" (UniqueName: \"kubernetes.io/projected/00e48021-2e87-4326-916c-e6fa5430a8d5-kube-api-access-9tf4x\") pod \"iptables-alerter-nnklb\" (UID: \"00e48021-2e87-4326-916c-e6fa5430a8d5\") " pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.679175 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.679132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swctb\" (UniqueName: \"kubernetes.io/projected/4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14-kube-api-access-swctb\") pod \"multus-fbz8c\" (UID: \"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14\") " pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:15.679517 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.679492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hs6\" (UniqueName: \"kubernetes.io/projected/2d9f0db8-c95d-49de-bd7d-49d2207b6170-kube-api-access-s7hs6\") pod \"multus-additional-cni-plugins-s4bg9\" (UID: \"2d9f0db8-c95d-49de-bd7d-49d2207b6170\") " pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.679679 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.679657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxr8\" (UniqueName: \"kubernetes.io/projected/45d028c1-3064-40db-9cdc-a0063eae53d4-kube-api-access-fsxr8\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:15.679755 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.679704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f85n\" (UniqueName: \"kubernetes.io/projected/ee634728-10e6-46d5-987c-9a9f28873e67-kube-api-access-6f85n\") pod \"node-ca-6f4b6\" (UID: \"ee634728-10e6-46d5-987c-9a9f28873e67\") " pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.760693 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.760597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:15.775811 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.775778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:15.784087 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.784065    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm"
Jul 12 14:41:15.799095 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.799068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6fzfj"
Jul 12 14:41:15.807907 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.807886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ddz4m"
Jul 12 14:41:15.816498 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.816474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnklb"
Jul 12 14:41:15.825371 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.825345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4bg9"
Jul 12 14:41:15.833261 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.833239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6f4b6"
Jul 12 14:41:15.840065 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:15.840043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fbz8c"
Jul 12 14:41:16.174491 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.174391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:16.174491 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.174448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:16.174736 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.174573    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:16.174736 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.174596    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:16.174736 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.174656    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:17.174637769 +0000 UTC m=+4.064782535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:16.174736 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.174679    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:17.174667975 +0000 UTC m=+4.064812740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:16.274936 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.274897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:16.275112 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.275037    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:16.275112 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.275053    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:16.275112 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.275064    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:16.275238 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.275116    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:17.275102499 +0000 UTC m=+4.165247265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:16.506096 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.506003    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 14:36:15 +0000 UTC" deadline="2028-02-04 14:56:13.492238639 +0000 UTC"
Jul 12 14:41:16.506096 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.506053    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13728h14m56.986194824s"
Jul 12 14:41:16.606083 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.606057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:16.606224 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.606098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:16.606274 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.606221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:16.606368 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:16.606348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:16.610002 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.609978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a36f31_abd5_4a71_8d9e_df2e5ea8f4e6.slice/crio-1f9c023f629ace8bb8fa71c9bf7b864305ef0e11c6ffb216f64021dea7ad804f WatchSource:0}: Error finding container 1f9c023f629ace8bb8fa71c9bf7b864305ef0e11c6ffb216f64021dea7ad804f: Status 404 returned error can't find the container with id 1f9c023f629ace8bb8fa71c9bf7b864305ef0e11c6ffb216f64021dea7ad804f
Jul 12 14:41:16.611236 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.611151    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9f0db8_c95d_49de_bd7d_49d2207b6170.slice/crio-1e01510d578852b494f5687e94e068753d6150b98e75a84908835269869f1271 WatchSource:0}: Error finding container 1e01510d578852b494f5687e94e068753d6150b98e75a84908835269869f1271: Status 404 returned error can't find the container with id 1e01510d578852b494f5687e94e068753d6150b98e75a84908835269869f1271
Jul 12 14:41:16.614766 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:16.614330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmzdc" event={"ID":"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6","Type":"ContainerStarted","Data":"1f9c023f629ace8bb8fa71c9bf7b864305ef0e11c6ffb216f64021dea7ad804f"}
Jul 12 14:41:16.616199 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.616176    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0f31f8_3a4d_4d1f_86ee_d315ce1edc14.slice/crio-43eec8ab859e1a1386ff059dd852d0c1d7f178667ad730fcf2116e6a0e9b3f99 WatchSource:0}: Error finding container 43eec8ab859e1a1386ff059dd852d0c1d7f178667ad730fcf2116e6a0e9b3f99: Status 404 returned error can't find the container with id 43eec8ab859e1a1386ff059dd852d0c1d7f178667ad730fcf2116e6a0e9b3f99
Jul 12 14:41:16.617730 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.617672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee634728_10e6_46d5_987c_9a9f28873e67.slice/crio-23b9e253d8b8f752ae01ee58f18b97d6cd9530b0473d0d7221b2ed61ae5c04e0 WatchSource:0}: Error finding container 23b9e253d8b8f752ae01ee58f18b97d6cd9530b0473d0d7221b2ed61ae5c04e0: Status 404 returned error can't find the container with id 23b9e253d8b8f752ae01ee58f18b97d6cd9530b0473d0d7221b2ed61ae5c04e0
Jul 12 14:41:16.619668 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.619342    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29880605_576e_453a_8e7c_41d2f91902a2.slice/crio-d192badf156c899a43ef7dd85d99adf53be87d5bf0e9ee20e39030b130fe22b9 WatchSource:0}: Error finding container d192badf156c899a43ef7dd85d99adf53be87d5bf0e9ee20e39030b130fe22b9: Status 404 returned error can't find the container with id d192badf156c899a43ef7dd85d99adf53be87d5bf0e9ee20e39030b130fe22b9
Jul 12 14:41:16.620001 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:16.619941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e48021_2e87_4326_916c_e6fa5430a8d5.slice/crio-72d09d86afcb99eb650c69cd90654fa39de6ee896d41633a2ea581b235ad7be5 WatchSource:0}: Error finding container 72d09d86afcb99eb650c69cd90654fa39de6ee896d41633a2ea581b235ad7be5: Status 404 returned error can't find the container with id 72d09d86afcb99eb650c69cd90654fa39de6ee896d41633a2ea581b235ad7be5
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.184117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.184446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.184594    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.184674    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:19.184652713 +0000 UTC m=+6.074797482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.185125    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:17.185291 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.185176    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:19.185159976 +0000 UTC m=+6.075304743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:17.286035 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.285313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:17.286035 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.285560    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:17.286035 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.285582    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:17.286035 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.285596    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:17.286035 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.285662    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:19.285642094 +0000 UTC m=+6.175786862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:17.507061 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.506947    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 14:36:15 +0000 UTC" deadline="2028-01-01 04:15:36.458942625 +0000 UTC"
Jul 12 14:41:17.507061 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.507011    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12901h34m18.951936185s"
Jul 12 14:41:17.608927 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.608512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:17.608927 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:17.608638    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:17.626945 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.626891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm" event={"ID":"29880605-576e-453a-8e7c-41d2f91902a2","Type":"ContainerStarted","Data":"d192badf156c899a43ef7dd85d99adf53be87d5bf0e9ee20e39030b130fe22b9"}
Jul 12 14:41:17.630378 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.630345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6f4b6" event={"ID":"ee634728-10e6-46d5-987c-9a9f28873e67","Type":"ContainerStarted","Data":"23b9e253d8b8f752ae01ee58f18b97d6cd9530b0473d0d7221b2ed61ae5c04e0"}
Jul 12 14:41:17.640616 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.640572    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fbz8c" event={"ID":"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14","Type":"ContainerStarted","Data":"43eec8ab859e1a1386ff059dd852d0c1d7f178667ad730fcf2116e6a0e9b3f99"}
Jul 12 14:41:17.648305 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.648272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6fzfj" event={"ID":"b1e6febf-d5cc-470f-98aa-078dd955bc2d","Type":"ContainerStarted","Data":"4a5b6d8784655f2bba5683465110f1e1129e58cd33687849c93d3de0588f3cd6"}
Jul 12 14:41:17.651952 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.651917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerStarted","Data":"1e01510d578852b494f5687e94e068753d6150b98e75a84908835269869f1271"}
Jul 12 14:41:17.658798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.658750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal" event={"ID":"8fdfd063a846aba40894375a4d9f448c","Type":"ContainerStarted","Data":"1f21d60dec27200602da0b755e20c8585e7b72e756b03b8b07a9cc301d00b340"}
Jul 12 14:41:17.673240 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.673204    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4dfe26b9aba197acf72330bd8b23093" containerID="20b659b52d56e882328012e9aedb537666ad3e6874ebaf5f912960cfac31107f" exitCode=0
Jul 12 14:41:17.673415 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.673295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal" event={"ID":"f4dfe26b9aba197acf72330bd8b23093","Type":"ContainerDied","Data":"20b659b52d56e882328012e9aedb537666ad3e6874ebaf5f912960cfac31107f"}
Jul 12 14:41:17.675373 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.675325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-143.ec2.internal" podStartSLOduration=2.675306861 podStartE2EDuration="2.675306861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:17.674235118 +0000 UTC m=+4.564379907" watchObservedRunningTime="2026-07-12 14:41:17.675306861 +0000 UTC m=+4.565451648"
Jul 12 14:41:17.691902 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.691866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ddz4m" event={"ID":"51e72614-2f15-488e-809c-9c6cf457b196","Type":"ContainerStarted","Data":"3b637db0db7e1f1291b2309c835b52c0cc5b34a165abfba7cfbaf0ea3b12fcc8"}
Jul 12 14:41:17.711936 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.711371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"919efc35a8f7e94bb5954e169be80de34c8d9107ac7d3c18e89ce4843b251ea3"}
Jul 12 14:41:17.730805 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:17.730660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnklb" event={"ID":"00e48021-2e87-4326-916c-e6fa5430a8d5","Type":"ContainerStarted","Data":"72d09d86afcb99eb650c69cd90654fa39de6ee896d41633a2ea581b235ad7be5"}
Jul 12 14:41:18.605988 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:18.605955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:18.606534 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:18.606086    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:18.606534 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:18.606242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:18.606534 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:18.606368    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:18.750252 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:18.750181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal" event={"ID":"f4dfe26b9aba197acf72330bd8b23093","Type":"ContainerStarted","Data":"a1ded5c5415349e4684d14605ab6e505b56587cb4026ace99309d98cdbb52af7"}
Jul 12 14:41:18.765585 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:18.765271    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-143.ec2.internal" podStartSLOduration=3.765248222 podStartE2EDuration="3.765248222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:18.76465082 +0000 UTC m=+5.654795613" watchObservedRunningTime="2026-07-12 14:41:18.765248222 +0000 UTC m=+5.655393009"
Jul 12 14:41:19.202405 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:19.202366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:19.202596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:19.202425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:19.202596 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.202580    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:19.202705 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.202646    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:23.202627467 +0000 UTC m=+10.092772235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:19.203414 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.203228    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:19.203414 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.203316    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:23.203297761 +0000 UTC m=+10.093442529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:19.303477 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:19.303439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:19.303687 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.303669    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:19.303749 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.303695    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:19.303749 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.303709    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:19.303855 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.303774    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:23.303747115 +0000 UTC m=+10.193891881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:19.606243 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:19.605988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:19.606243 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:19.606143    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:20.606022 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:20.605990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:20.606214 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:20.606037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:20.606293 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:20.606230    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:20.606641 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:20.606296    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:21.606218 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:21.606063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:21.606385 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:21.606220    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:22.605973 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:22.605940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:22.606190 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:22.605986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:22.606190 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:22.606085    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:22.606294 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:22.606231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:23.237489 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:23.236996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:23.237489 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:23.237048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:23.237489 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.237213    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:23.237489 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.237273    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:31.237255153 +0000 UTC m=+18.127399917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:23.237489 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.237446    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:23.238110 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.237512    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:31.237493401 +0000 UTC m=+18.127638169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:23.337459 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:23.337409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:23.337616 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.337592    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:23.337659 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.337625    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:23.337659 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.337644    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:23.337722 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.337716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:31.337694577 +0000 UTC m=+18.227839356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:23.606237 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:23.606119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:23.611538 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:23.610181    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:24.605393 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:24.605356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:24.605857 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:24.605358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:24.605857 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:24.605508    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:24.605857 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:24.605581    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:25.605438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:25.605388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:25.605871 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:25.605524    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:26.606318 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:26.605755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:26.606318 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:26.605876    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:26.606318 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:26.605757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:26.606318 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:26.606315    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:27.605328 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:27.605298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:27.605487 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:27.605468    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:28.605806 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:28.605770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:28.606236 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:28.605778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:28.606236 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:28.605905    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:28.606236 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:28.605985    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:29.606239 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:29.606197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:29.606749 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:29.606339    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:30.605384 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:30.605345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:30.605590 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:30.605345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:30.605590 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:30.605473    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:30.605590 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:30.605543    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:31.303708 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:31.303674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:31.304138 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:31.303720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:31.304138 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.303828    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:31.304138 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.303837    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:31.304138 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.303895    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:41:47.303876566 +0000 UTC m=+34.194021337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:31.304138 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.303910    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:41:47.30390452 +0000 UTC m=+34.194049284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:31.404481 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:31.404442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:31.404661 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.404600    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:31.404661 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.404622    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:31.404661 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.404635    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:31.404788 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.404696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:41:47.404678592 +0000 UTC m=+34.294823367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:31.605726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:31.605634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:31.605862 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:31.605825    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:32.605458 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:32.605415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:32.605921 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:32.605414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:32.605921 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:32.605558    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:32.605921 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:32.605633    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:33.606161 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:33.606111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:33.606607 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:33.606235    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:34.605934 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:34.605871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:34.605934 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:34.605923    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:34.606246 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:34.606003    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:34.606246 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:34.606105    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:35.605870 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.605620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:35.606036 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:35.605958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:35.784617 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.784585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6f4b6" event={"ID":"ee634728-10e6-46d5-987c-9a9f28873e67","Type":"ContainerStarted","Data":"6ef619e843dc3868f83d53fad9816657921977a33a9ba51e202c42e07ace8084"}
Jul 12 14:41:35.786077 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.786052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fbz8c" event={"ID":"4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14","Type":"ContainerStarted","Data":"493408d1c00244b634fe325a526fb1b906d437d286392efc017c3d76e653de18"}
Jul 12 14:41:35.787641 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.787619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmzdc" event={"ID":"71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6","Type":"ContainerStarted","Data":"fcdce42cececb68601fbf97cbb08b9fcb953e3d6daed86bfb24c2967549e47fb"}
Jul 12 14:41:35.789171 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.789104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6fzfj" event={"ID":"b1e6febf-d5cc-470f-98aa-078dd955bc2d","Type":"ContainerStarted","Data":"40d976b3a17f99510e8549c741c4eb4613ea8ba032629289760b0cf910b4f1c1"}
Jul 12 14:41:35.790807 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.790784    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="d8ca3f6611c1322bd2fc65793e21a0f010fcc2b77a03a7ac8283040e24dee0f7" exitCode=0
Jul 12 14:41:35.790919 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.790876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"d8ca3f6611c1322bd2fc65793e21a0f010fcc2b77a03a7ac8283040e24dee0f7"}
Jul 12 14:41:35.793155 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.792957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ddz4m" event={"ID":"51e72614-2f15-488e-809c-9c6cf457b196","Type":"ContainerStarted","Data":"28e91c1620fcd737b2889c4e5ff828ecca63f9c1c5226ef4e98a2d0730ac59af"}
Jul 12 14:41:35.795539 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.795517    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:41:35.795908 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.795883    2581 generic.go:356] "Generic (PLEG): container finished" podID="68de21e2-4f82-4470-b615-94d403406a30" containerID="1e42cb24efc07d2d42df724be32383314bed8f61b20ad54052df36eac87cd566" exitCode=1
Jul 12 14:41:35.795981 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.795961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"a8162cbc08c1062881e1a21c869156f2ff110a855b3bb40fa8d9f4ad6b6d8956"}
Jul 12 14:41:35.796060 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.796039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerDied","Data":"1e42cb24efc07d2d42df724be32383314bed8f61b20ad54052df36eac87cd566"}
Jul 12 14:41:35.796118 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.796100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"8a4b7dd0280521e4e5bd219c9e05dd77424c825f577fff6112e04d22f390dffa"}
Jul 12 14:41:35.797307 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.797271    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6f4b6" podStartSLOduration=3.052889846 podStartE2EDuration="21.797258764s" totalImagesPullingTime="18.744368918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:35.796729375 +0000 UTC m=+22.686874161" watchObservedRunningTime="2026-07-12 14:41:35.797258764 +0000 UTC m=+22.687403582"
Jul 12 14:41:35.798205 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.798176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm" event={"ID":"29880605-576e-453a-8e7c-41d2f91902a2","Type":"ContainerStarted","Data":"3f4065c7291fd1decad62852b05a90131c82a957fab717ceb7e3d18f6cd5818b"}
Jul 12 14:41:35.809800 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.809612    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bmzdc" podStartSLOduration=8.257259443 podStartE2EDuration="22.809596613s" totalImagesPullingTime="14.55233717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:35.809181817 +0000 UTC m=+22.699326648" watchObservedRunningTime="2026-07-12 14:41:35.809596613 +0000 UTC m=+22.699741395"
Jul 12 14:41:35.856579 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.856530    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6fzfj" podStartSLOduration=4.088227306 podStartE2EDuration="22.856512069s" totalImagesPullingTime="18.768284763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:35.843597374 +0000 UTC m=+22.733742155" watchObservedRunningTime="2026-07-12 14:41:35.856512069 +0000 UTC m=+22.746656858"
Jul 12 14:41:35.857033 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.857005    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ddz4m" podStartSLOduration=8.316334388 podStartE2EDuration="22.856995183s" totalImagesPullingTime="14.540660795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:35.856678641 +0000 UTC m=+22.746823421" watchObservedRunningTime="2026-07-12 14:41:35.856995183 +0000 UTC m=+22.747139967"
Jul 12 14:41:35.876482 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:35.876434    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fbz8c" podStartSLOduration=2.833705912 podStartE2EDuration="21.876418039s" totalImagesPullingTime="19.042712127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:35.876294654 +0000 UTC m=+22.766439440" watchObservedRunningTime="2026-07-12 14:41:35.876418039 +0000 UTC m=+22.766562823"
Jul 12 14:41:36.605435 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.605395    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:36.605784 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.605397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:36.605784 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:36.605509    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:36.605784 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:36.605640    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:36.804239 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.804208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:41:36.804761 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.804735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"7f4271827606100396bf2f001be8867c795f514a8738102e45baef5968051407"}
Jul 12 14:41:36.804863 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.804824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"9d3adbedb960ccc637c444867d5cb4a1a2fb612e952eccbf65912e53ba467487"}
Jul 12 14:41:36.804863 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.804857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"d26939721a52eb3bc736182fd6828ea4ef3929b4ac49d1624f293c2b798b586f"}
Jul 12 14:41:36.806492 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.806461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnklb" event={"ID":"00e48021-2e87-4326-916c-e6fa5430a8d5","Type":"ContainerStarted","Data":"7ddb62967d0be2d358766e4b1a0d0aaefc3fe6ec334ebfb5aa2185c61d98c89b"}
Jul 12 14:41:36.822395 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.822337    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnklb" podStartSLOduration=4.06367664 podStartE2EDuration="22.822316636s" totalImagesPullingTime="18.758639996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:36.821556595 +0000 UTC m=+23.711701381" watchObservedRunningTime="2026-07-12 14:41:36.822316636 +0000 UTC m=+23.712461422"
Jul 12 14:41:36.988601 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:36.988447    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 14:41:37.540487 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:37.540376    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T14:41:36.988590822Z","UUID":"51396fab-341d-4034-9827-ed29b886858b","Handler":null,"Name":"","Endpoint":""}
Jul 12 14:41:37.542546 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:37.542520    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 14:41:37.542687 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:37.542573    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 14:41:37.605868 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:37.605840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:37.606085 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:37.605977    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:37.810305 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:37.810215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm" event={"ID":"29880605-576e-453a-8e7c-41d2f91902a2","Type":"ContainerStarted","Data":"0bbd6cff606c96ff90da6d1e67ec2f6b16315e377fa38efd6a61ab2f3523ec61"}
Jul 12 14:41:38.606138 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.606079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:38.606138 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.606120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:38.606403 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:38.606231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:38.606403 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:38.606361    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:38.817075 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.817045    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:41:38.817551 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.817521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"3056361e53fba4bc3ab8c3290d3333ba3c5bd42bc6f5ab3d723c8ff8873da5e6"}
Jul 12 14:41:38.819916 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.819845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm" event={"ID":"29880605-576e-453a-8e7c-41d2f91902a2","Type":"ContainerStarted","Data":"8a11a280a509d03f5196581de687224396f77f08c3019eb28a18cbc94d7b0396"}
Jul 12 14:41:38.837751 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:38.837691    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbckm" podStartSLOduration=4.772188902 podStartE2EDuration="25.837668602s" totalImagesPullingTime="21.0654797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:38.836622545 +0000 UTC m=+25.726767329" watchObservedRunningTime="2026-07-12 14:41:38.837668602 +0000 UTC m=+25.727813389"
Jul 12 14:41:39.605581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:39.605543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:39.605750 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:39.605692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:40.171848 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.171813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:40.172578 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.172448    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:40.606017 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.605981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:40.606225 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.605981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:40.606225 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:40.606106    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:40.606225 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:40.606206    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:40.825412 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.825376    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:40.826026 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:40.826004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bmzdc"
Jul 12 14:41:41.605582 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.605399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:41.606065 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:41.605666    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:41.829530 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.829502    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="a825177ff06e524f13becf421660b2e802ab907793f5af178f5f24b8f6e72542" exitCode=0
Jul 12 14:41:41.829704 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.829584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"a825177ff06e524f13becf421660b2e802ab907793f5af178f5f24b8f6e72542"}
Jul 12 14:41:41.835427 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.835406    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:41:41.835825 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.835798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"180ccb73b4cfb07ba5159f228412776d8d2daa350b19e99efdbc6f508b8c2f74"}
Jul 12 14:41:41.836109 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.836093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:41.836202 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.836181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:41.836313 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.836294    2581 scope.go:117] "RemoveContainer" containerID="1e42cb24efc07d2d42df724be32383314bed8f61b20ad54052df36eac87cd566"
Jul 12 14:41:41.852847 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:41.852825    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:42.605436 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.605399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:42.605688 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.605401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:42.605688 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:42.605556    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:42.605688 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:42.605597    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:42.841769 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.841605    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:41:42.842639 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.842180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" event={"ID":"68de21e2-4f82-4470-b615-94d403406a30","Type":"ContainerStarted","Data":"aa3299d56f38800423301ae51168a72e16a3efaa4341ac66ac5edd469b808015"}
Jul 12 14:41:42.842639 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.842531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:42.859294 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.859269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:41:42.869781 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:42.869733    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz" podStartSLOduration=11.086526016 podStartE2EDuration="29.869717518s" totalImagesPullingTime="18.783191502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:42.869215829 +0000 UTC m=+29.759360615" watchObservedRunningTime="2026-07-12 14:41:42.869717518 +0000 UTC m=+29.759862302"
Jul 12 14:41:43.004776 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.004748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhb57"]
Jul 12 14:41:43.004956 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.004863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:43.005019 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:43.004972    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:43.007170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.007144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hblh4"]
Jul 12 14:41:43.007302 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.007263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:43.007380 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:43.007358    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:43.020239 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.020209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4pl4"]
Jul 12 14:41:43.020374 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.020317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:43.020421 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:43.020407    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:43.847055 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.847015    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="4ed542ef841b2a8e7a971238e2d31ea0c495001ad675842dcd96b79a0ed15813" exitCode=0
Jul 12 14:41:43.847773 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:43.847116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"4ed542ef841b2a8e7a971238e2d31ea0c495001ad675842dcd96b79a0ed15813"}
Jul 12 14:41:44.605702 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:44.605662    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:44.605880 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:44.605767    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:44.605880 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:44.605784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:44.605880 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:44.605674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:44.606037 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:44.605883    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:44.606037 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:44.605924    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:45.854542 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:45.854510    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="dd6c06066f6f2471ee5c83a96a1229483948a88d0b15c257a0356eaadf8033f5" exitCode=0
Jul 12 14:41:45.855105 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:45.854557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"dd6c06066f6f2471ee5c83a96a1229483948a88d0b15c257a0356eaadf8033f5"}
Jul 12 14:41:46.605985 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:46.605729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:46.606172 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:46.605760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:46.606172 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:46.606098    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhb57" podUID="43fa45f1-36ac-4043-beda-74d189b4d35b"
Jul 12 14:41:46.606172 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:46.605760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:46.606304 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:46.606164    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:41:46.606304 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:46.606209    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hblh4" podUID="95031669-1881-4966-ad9c-9fd3101388fa"
Jul 12 14:41:47.324544 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:47.324507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:47.325003 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:47.324552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:47.325003 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.324667    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:47.325003 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.324678    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:47.325003 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.324737    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:42:19.324718606 +0000 UTC m=+66.214863375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 14:41:47.325003 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.324753    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret podName:43fa45f1-36ac-4043-beda-74d189b4d35b nodeName:}" failed. No retries permitted until 2026-07-12 14:42:19.32474645 +0000 UTC m=+66.214891213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret") pod "global-pull-secret-syncer-qhb57" (UID: "43fa45f1-36ac-4043-beda-74d189b4d35b") : object "kube-system"/"original-pull-secret" not registered
Jul 12 14:41:47.424957 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:47.424917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:47.425169 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.425110    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 14:41:47.425169 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.425156    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 14:41:47.425169 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.425168    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pjfvm for pod openshift-network-diagnostics/network-check-target-hblh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:47.425345 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:47.425224    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm podName:95031669-1881-4966-ad9c-9fd3101388fa nodeName:}" failed. No retries permitted until 2026-07-12 14:42:19.425208222 +0000 UTC m=+66.315352985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfvm" (UniqueName: "kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm") pod "network-check-target-hblh4" (UID: "95031669-1881-4966-ad9c-9fd3101388fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 14:41:48.432180 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.432148    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-143.ec2.internal" event="NodeReady"
Jul 12 14:41:48.432674 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.432316    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 14:41:48.477976 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.477873    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pr645"]
Jul 12 14:41:48.480001 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.479975    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6qw5w"]
Jul 12 14:41:48.480167 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.480137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.481871 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.481796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.482286 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.482255    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 14:41:48.482412 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.482391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 14:41:48.482412 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.482391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6rsjr\""
Jul 12 14:41:48.482532 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.482419    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 14:41:48.483679 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.483660    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 14:41:48.483785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.483756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff579\""
Jul 12 14:41:48.484420 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.484402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 14:41:48.488804 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.488740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pr645"]
Jul 12 14:41:48.493162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.492660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qw5w"]
Jul 12 14:41:48.605302 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.605270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:41:48.605485 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.605372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:41:48.605550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.605493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:41:48.608058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.607899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s8bwx\""
Jul 12 14:41:48.608058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.607913    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 14:41:48.608058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.607921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 14:41:48.608058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.607914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 14:41:48.608058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.607964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 14:41:48.608445 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.608084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6tgvw\""
Jul 12 14:41:48.634917 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.634870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9498cfe-27dd-4a0d-a175-d974f81adfce-cert\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.635078 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.634928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.635078 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.634951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxvf\" (UniqueName: \"kubernetes.io/projected/ccdf7363-d0da-432d-95f2-68e8aa96527f-kube-api-access-tcxvf\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.635078 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.634975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdf7363-d0da-432d-95f2-68e8aa96527f-config-volume\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.635078 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.635012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccdf7363-d0da-432d-95f2-68e8aa96527f-tmp-dir\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.635258 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.635097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4bg\" (UniqueName: \"kubernetes.io/projected/e9498cfe-27dd-4a0d-a175-d974f81adfce-kube-api-access-wn4bg\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.735512 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccdf7363-d0da-432d-95f2-68e8aa96527f-tmp-dir\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.735512 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4bg\" (UniqueName: \"kubernetes.io/projected/e9498cfe-27dd-4a0d-a175-d974f81adfce-kube-api-access-wn4bg\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.735726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9498cfe-27dd-4a0d-a175-d974f81adfce-cert\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.735726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.735726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxvf\" (UniqueName: \"kubernetes.io/projected/ccdf7363-d0da-432d-95f2-68e8aa96527f-kube-api-access-tcxvf\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.735726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdf7363-d0da-432d-95f2-68e8aa96527f-config-volume\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.735948 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:48.735780    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:41:48.735948 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:48.735841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:41:49.235821349 +0000 UTC m=+36.125966116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:41:48.735948 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.735847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccdf7363-d0da-432d-95f2-68e8aa96527f-tmp-dir\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.736341 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.736321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccdf7363-d0da-432d-95f2-68e8aa96527f-config-volume\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.740540 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.740516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9498cfe-27dd-4a0d-a175-d974f81adfce-cert\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.744323 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.744292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxvf\" (UniqueName: \"kubernetes.io/projected/ccdf7363-d0da-432d-95f2-68e8aa96527f-kube-api-access-tcxvf\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:48.744487 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.744375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4bg\" (UniqueName: \"kubernetes.io/projected/e9498cfe-27dd-4a0d-a175-d974f81adfce-kube-api-access-wn4bg\") pod \"ingress-canary-pr645\" (UID: \"e9498cfe-27dd-4a0d-a175-d974f81adfce\") " pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.794242 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.794199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pr645"
Jul 12 14:41:48.941841 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:48.941809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pr645"]
Jul 12 14:41:49.240205 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:49.240171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:49.240374 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:49.240306    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:41:49.240374 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:49.240368    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:41:50.240352229 +0000 UTC m=+37.130496998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:41:50.248626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:50.248585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:50.249041 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:50.248714    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:41:50.249041 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:50.248790    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:41:52.248769012 +0000 UTC m=+39.138913776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:41:50.311516 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:41:50.311470    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9498cfe_27dd_4a0d_a175_d974f81adfce.slice/crio-6340758f3c6a35708056b7a053b34cf276fd4337dfc66a6f21918be495cbcfae WatchSource:0}: Error finding container 6340758f3c6a35708056b7a053b34cf276fd4337dfc66a6f21918be495cbcfae: Status 404 returned error can't find the container with id 6340758f3c6a35708056b7a053b34cf276fd4337dfc66a6f21918be495cbcfae
Jul 12 14:41:50.870810 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:50.870603    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="f1953b8a06b473b530e0324956a8fd1feea014ff5943763c973d19baec879e25" exitCode=0
Jul 12 14:41:50.871000 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:50.870690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"f1953b8a06b473b530e0324956a8fd1feea014ff5943763c973d19baec879e25"}
Jul 12 14:41:50.872146 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:50.872102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pr645" event={"ID":"e9498cfe-27dd-4a0d-a175-d974f81adfce","Type":"ContainerStarted","Data":"6340758f3c6a35708056b7a053b34cf276fd4337dfc66a6f21918be495cbcfae"}
Jul 12 14:41:51.878304 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:51.878266    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d9f0db8-c95d-49de-bd7d-49d2207b6170" containerID="59b7e1b440760abc85fd5fcd33c5e80c284fcdc63786d371259aabeca2d71b97" exitCode=0
Jul 12 14:41:51.878942 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:51.878314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerDied","Data":"59b7e1b440760abc85fd5fcd33c5e80c284fcdc63786d371259aabeca2d71b97"}
Jul 12 14:41:52.266112 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:52.266025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:52.266301 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:52.266216    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:41:52.266301 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:52.266295    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:41:56.266269026 +0000 UTC m=+43.156413808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:41:52.884603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:52.884568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" event={"ID":"2d9f0db8-c95d-49de-bd7d-49d2207b6170","Type":"ContainerStarted","Data":"ae01930e89baf4886d21a62fbabd1d06bcfd735178aa58a6bbc3cdd012353d88"}
Jul 12 14:41:52.886061 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:52.886035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pr645" event={"ID":"e9498cfe-27dd-4a0d-a175-d974f81adfce","Type":"ContainerStarted","Data":"907813a4690c17aa2bc76330705e74c1a0b178beb4c0eb2baf8d204345617c58"}
Jul 12 14:41:52.908321 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:52.908265    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s4bg9" podStartSLOduration=8.115226995 podStartE2EDuration="38.908249281s" totalImagesPullingTime="30.793022286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:52.90792863 +0000 UTC m=+39.798073414" watchObservedRunningTime="2026-07-12 14:41:52.908249281 +0000 UTC m=+39.798394065"
Jul 12 14:41:52.923657 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:52.923606    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pr645" podStartSLOduration=2.674372616 podStartE2EDuration="4.923590958s" totalImagesPullingTime="2.249218342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:41:52.922887202 +0000 UTC m=+39.813031990" watchObservedRunningTime="2026-07-12 14:41:52.923590958 +0000 UTC m=+39.813735743"
Jul 12 14:41:56.293463 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:41:56.293421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:41:56.293877 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:56.293583    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:41:56.293877 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:41:56.293662    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:42:04.293643853 +0000 UTC m=+51.183788616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:42:04.349235 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:04.349194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:42:04.349629 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:04.349340    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:42:04.349629 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:04.349415    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:42:20.34939929 +0000 UTC m=+67.239544052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:42:14.860180 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:14.860152    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvdz"
Jul 12 14:42:19.352277 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.352236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:42:19.352741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.352284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:42:19.354860 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.354837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 14:42:19.354978 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.354842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 14:42:19.362992 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:19.362958    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 14:42:19.363056 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:19.363041    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:43:23.363021227 +0000 UTC m=+130.253165990 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : secret "metrics-daemon-secret" not found
Jul 12 14:42:19.366180 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.366158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fa45f1-36ac-4043-beda-74d189b4d35b-original-pull-secret\") pod \"global-pull-secret-syncer-qhb57\" (UID: \"43fa45f1-36ac-4043-beda-74d189b4d35b\") " pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:42:19.453380 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.453342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:42:19.455683 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.455663    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 14:42:19.466321 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.466296    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 14:42:19.477314 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.477290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfvm\" (UniqueName: \"kubernetes.io/projected/95031669-1881-4966-ad9c-9fd3101388fa-kube-api-access-pjfvm\") pod \"network-check-target-hblh4\" (UID: \"95031669-1881-4966-ad9c-9fd3101388fa\") " pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:42:19.518195 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.518159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhb57"
Jul 12 14:42:19.534524 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.534498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s8bwx\""
Jul 12 14:42:19.542341 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.542309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:42:19.651744 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.651660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhb57"]
Jul 12 14:42:19.656459 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:42:19.656432    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fa45f1_36ac_4043_beda_74d189b4d35b.slice/crio-e1e98c8d2c9a28b20ef71dcfe5f9b1caf3cd6a97aa0ff86aad47bcc81b25ab3e WatchSource:0}: Error finding container e1e98c8d2c9a28b20ef71dcfe5f9b1caf3cd6a97aa0ff86aad47bcc81b25ab3e: Status 404 returned error can't find the container with id e1e98c8d2c9a28b20ef71dcfe5f9b1caf3cd6a97aa0ff86aad47bcc81b25ab3e
Jul 12 14:42:19.675942 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.675867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hblh4"]
Jul 12 14:42:19.679520 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:42:19.679493    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95031669_1881_4966_ad9c_9fd3101388fa.slice/crio-e16e35c8130d4e8a4b77013b10f964f23b4dba021070a1897fc8fd4b2df56afb WatchSource:0}: Error finding container e16e35c8130d4e8a4b77013b10f964f23b4dba021070a1897fc8fd4b2df56afb: Status 404 returned error can't find the container with id e16e35c8130d4e8a4b77013b10f964f23b4dba021070a1897fc8fd4b2df56afb
Jul 12 14:42:19.952051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.951961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hblh4" event={"ID":"95031669-1881-4966-ad9c-9fd3101388fa","Type":"ContainerStarted","Data":"e16e35c8130d4e8a4b77013b10f964f23b4dba021070a1897fc8fd4b2df56afb"}
Jul 12 14:42:19.952988 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:19.952954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhb57" event={"ID":"43fa45f1-36ac-4043-beda-74d189b4d35b","Type":"ContainerStarted","Data":"e1e98c8d2c9a28b20ef71dcfe5f9b1caf3cd6a97aa0ff86aad47bcc81b25ab3e"}
Jul 12 14:42:20.360845 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:20.360808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:42:20.361328 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:20.360998    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:42:20.361328 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:20.361080    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:42:52.361057298 +0000 UTC m=+99.251202073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:42:24.967224 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:24.967182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hblh4" event={"ID":"95031669-1881-4966-ad9c-9fd3101388fa","Type":"ContainerStarted","Data":"a1ccdc34ae91514ddaadec413cac329e1dec1fc383740155f2bab2bd33b1a960"}
Jul 12 14:42:24.967682 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:24.967299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:42:24.968548 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:24.968525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhb57" event={"ID":"43fa45f1-36ac-4043-beda-74d189b4d35b","Type":"ContainerStarted","Data":"81b9c68169fef3cf18abdcc2bb4c4b529a37bf69120fb9ff0c706f45f7d1ee9d"}
Jul 12 14:42:24.981452 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:24.981400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hblh4" podStartSLOduration=67.444890148 podStartE2EDuration="1m11.981385442s" totalImagesPullingTime="4.536495294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:42:24.980944538 +0000 UTC m=+71.871089316" watchObservedRunningTime="2026-07-12 14:42:24.981385442 +0000 UTC m=+71.871530227"
Jul 12 14:42:24.993499 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:24.993440    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qhb57" podStartSLOduration=66.426682675 podStartE2EDuration="1m10.993420863s" totalImagesPullingTime="4.566738188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:42:24.993104552 +0000 UTC m=+71.883249347" watchObservedRunningTime="2026-07-12 14:42:24.993420863 +0000 UTC m=+71.883565677"
Jul 12 14:42:47.924236 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.924202    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"]
Jul 12 14:42:47.928284 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.928254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:47.932402 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.932380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 12 14:42:47.932624 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.932609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 12 14:42:47.933020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.932996    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 12 14:42:47.933263 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.933022    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 12 14:42:47.933263 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.933044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 12 14:42:47.933409 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.933394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 12 14:42:47.933870 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.933853    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 12 14:42:47.952967 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:47.952939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"]
Jul 12 14:42:48.047587 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.047587 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.047791 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.047791 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.047791 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9j9j\" (UniqueName: \"kubernetes.io/projected/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-kube-api-access-t9j9j\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.047791 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.047707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148419 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148419 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9j9j\" (UniqueName: \"kubernetes.io/projected/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-kube-api-access-t9j9j\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.148607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.148587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.149169 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.149119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.151105 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.151082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-ca\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.151208 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.151162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.151431 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.151408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.151468 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.151432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.158978 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.158945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9j9j\" (UniqueName: \"kubernetes.io/projected/0733a63c-d9cf-41b7-96e8-8f54b4c3fd63-kube-api-access-t9j9j\") pod \"cluster-proxy-proxy-agent-77bdb859f4-pzfqg\" (UID: \"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.249216 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.249105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:42:48.377255 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:48.377223    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"]
Jul 12 14:42:48.380239 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:42:48.380215    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0733a63c_d9cf_41b7_96e8_8f54b4c3fd63.slice/crio-04b6c1af60f83bbdf9ec760367903cdbc590ba7bfed14c8b087df85caa3e68fc WatchSource:0}: Error finding container 04b6c1af60f83bbdf9ec760367903cdbc590ba7bfed14c8b087df85caa3e68fc: Status 404 returned error can't find the container with id 04b6c1af60f83bbdf9ec760367903cdbc590ba7bfed14c8b087df85caa3e68fc
Jul 12 14:42:49.029169 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:49.029117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerStarted","Data":"04b6c1af60f83bbdf9ec760367903cdbc590ba7bfed14c8b087df85caa3e68fc"}
Jul 12 14:42:52.039028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:52.038993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerStarted","Data":"cfd39c6f675a5c53497e87fadddbc3be62f0ed8a7d7abe2450c271d49d94a813"}
Jul 12 14:42:52.381891 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:52.381852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:42:52.382080 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:52.381970    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:42:52.382080 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:42:52.382025    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:43:56.382012027 +0000 UTC m=+163.272156790 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:42:53.044018 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:53.043981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerStarted","Data":"ea81e752816dca95fdf302cb2dc9ac7ab0c52dbe13b9c0c84e14ea6411d8f29f"}
Jul 12 14:42:53.044419 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:53.044026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerStarted","Data":"f452b3179024481b21e4aa8f3fbe738053e9d9f85df921f2bb56b80d425f47b8"}
Jul 12 14:42:53.070850 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:53.070793    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" podStartSLOduration=2.5058993640000002 podStartE2EDuration="6.070776105s" totalImagesPullingTime="3.564876741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:42:53.069023998 +0000 UTC m=+99.959168783" watchObservedRunningTime="2026-07-12 14:42:53.070776105 +0000 UTC m=+99.960920890"
Jul 12 14:42:55.973288 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:42:55.973257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hblh4"
Jul 12 14:43:23.390798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:43:23.390753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:43:23.391384 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:23.390913    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 14:43:23.391384 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:23.390998    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:25.390977789 +0000 UTC m=+252.281122557 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : secret "metrics-daemon-secret" not found
Jul 12 14:43:51.501148 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:51.501067    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6qw5w" podUID="ccdf7363-d0da-432d-95f2-68e8aa96527f"
Jul 12 14:43:51.625963 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:51.625910    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:43:52.212733 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:43:52.212704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:43:56.424321 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:43:56.424271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:43:56.424734 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:56.424392    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 14:43:56.424734 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:43:56.424449    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls podName:ccdf7363-d0da-432d-95f2-68e8aa96527f nodeName:}" failed. No retries permitted until 2026-07-12 14:45:58.424433735 +0000 UTC m=+285.314578499 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls") pod "dns-default-6qw5w" (UID: "ccdf7363-d0da-432d-95f2-68e8aa96527f") : secret "dns-default-metrics-tls" not found
Jul 12 14:44:04.605332 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:44:04.605280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:45:25.432436 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:25.432395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:45:25.432992 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:25.432525    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 14:45:25.432992 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:25.432610    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs podName:45d028c1-3064-40db-9cdc-a0063eae53d4 nodeName:}" failed. No retries permitted until 2026-07-12 14:47:27.432588727 +0000 UTC m=+374.322733489 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs") pod "network-metrics-daemon-q4pl4" (UID: "45d028c1-3064-40db-9cdc-a0063eae53d4") : secret "metrics-daemon-secret" not found
Jul 12 14:45:27.931984 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.931945    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxr9p"]
Jul 12 14:45:27.933776 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.933759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:27.936375 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.936353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 14:45:27.936490 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.936425    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 14:45:27.936557 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.936497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gccgz\""
Jul 12 14:45:27.936557 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.936506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 14:45:27.936827 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.936808    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 14:45:27.957636 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:27.957602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxr9p"]
Jul 12 14:45:28.047788 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.047750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09e9bd4f-4118-41a1-9106-944dcc312136-crio-socket\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.047954 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.047797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.047954 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.047840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/09e9bd4f-4118-41a1-9106-944dcc312136-kube-api-access-tc2sc\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.047954 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.047905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09e9bd4f-4118-41a1-9106-944dcc312136-data-volume\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.047954 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.047935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149055 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09e9bd4f-4118-41a1-9106-944dcc312136-crio-socket\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/09e9bd4f-4118-41a1-9106-944dcc312136-kube-api-access-tc2sc\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09e9bd4f-4118-41a1-9106-944dcc312136-data-volume\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09e9bd4f-4118-41a1-9106-944dcc312136-crio-socket\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149331 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.149331 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.149188    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 14:45:28.149331 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.149260    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:28.149331 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.149314    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:28.649296078 +0000 UTC m=+255.539440840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : configmap "kube-rbac-proxy" not found
Jul 12 14:45:28.149331 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.149328    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:28.649322271 +0000 UTC m=+255.539467034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:28.149518 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.149500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09e9bd4f-4118-41a1-9106-944dcc312136-data-volume\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.157578 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.157552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/09e9bd4f-4118-41a1-9106-944dcc312136-kube-api-access-tc2sc\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.652530 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.652495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.652706 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:28.652542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:28.652706 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.652619    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 14:45:28.652706 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.652647    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:28.652706 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.652666    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:29.652651252 +0000 UTC m=+256.542796015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : configmap "kube-rbac-proxy" not found
Jul 12 14:45:28.652706 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:28.652698    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:29.652684645 +0000 UTC m=+256.542829408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:29.659105 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:29.659070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:29.659503 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:29.659118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:29.659503 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:29.659218    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 14:45:29.659503 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:29.659297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:31.659278457 +0000 UTC m=+258.549423219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : configmap "kube-rbac-proxy" not found
Jul 12 14:45:29.659503 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:29.659229    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:29.659503 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:29.659372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:31.659357992 +0000 UTC m=+258.549502758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:29.691804 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:29.691780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ddz4m_51e72614-2f15-488e-809c-9c6cf457b196/dns-node-resolver/0.log"
Jul 12 14:45:30.688275 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:30.688245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6f4b6_ee634728-10e6-46d5-987c-9a9f28873e67/node-ca/0.log"
Jul 12 14:45:31.673094 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:31.673061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:31.673367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:31.673105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:31.673367 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:31.673247    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:31.673367 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:31.673311    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:35.673295819 +0000 UTC m=+262.563440582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:31.673367 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:31.673252    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 14:45:31.673505 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:31.673379    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:35.673366299 +0000 UTC m=+262.563511063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : configmap "kube-rbac-proxy" not found
Jul 12 14:45:31.687698 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:31.687670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pr645_e9498cfe-27dd-4a0d-a175-d974f81adfce/serve-healthcheck-canary/0.log"
Jul 12 14:45:35.700316 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:35.700237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:35.700316 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:35.700283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:35.700708 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:35.700384    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:35.700708 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:35.700447    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:43.700433188 +0000 UTC m=+270.590577956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : secret "insights-runtime-extractor-tls" not found
Jul 12 14:45:35.700708 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:35.700383    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 14:45:35.700708 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:35.700504    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm podName:09e9bd4f-4118-41a1-9106-944dcc312136 nodeName:}" failed. No retries permitted until 2026-07-12 14:45:43.700493455 +0000 UTC m=+270.590638218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxr9p" (UID: "09e9bd4f-4118-41a1-9106-944dcc312136") : configmap "kube-rbac-proxy" not found
Jul 12 14:45:43.764362 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.764319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:43.764750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.764374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:43.764824 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.764808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09e9bd4f-4118-41a1-9106-944dcc312136-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:43.766600 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.766580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09e9bd4f-4118-41a1-9106-944dcc312136-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxr9p\" (UID: \"09e9bd4f-4118-41a1-9106-944dcc312136\") " pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:43.842794 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.842760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxr9p"
Jul 12 14:45:43.962661 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:43.962623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxr9p"]
Jul 12 14:45:43.966264 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:45:43.966234    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e9bd4f_4118_41a1_9106_944dcc312136.slice/crio-305797b80a1c99b600f90afa7391fad8ca7ac27a656172755cabb877d3588c6a WatchSource:0}: Error finding container 305797b80a1c99b600f90afa7391fad8ca7ac27a656172755cabb877d3588c6a: Status 404 returned error can't find the container with id 305797b80a1c99b600f90afa7391fad8ca7ac27a656172755cabb877d3588c6a
Jul 12 14:45:44.521206 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:44.521111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxr9p" event={"ID":"09e9bd4f-4118-41a1-9106-944dcc312136","Type":"ContainerStarted","Data":"305797b80a1c99b600f90afa7391fad8ca7ac27a656172755cabb877d3588c6a"}
Jul 12 14:45:48.250712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:48.250660    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" podUID="0733a63c-d9cf-41b7-96e8-8f54b4c3fd63" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 14:45:48.535207 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:48.535105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxr9p" event={"ID":"09e9bd4f-4118-41a1-9106-944dcc312136","Type":"ContainerStarted","Data":"820d6b3425733499e97d6f5fef03114e7966c65faa2497cae9016e0699b4a682"}
Jul 12 14:45:48.535207 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:48.535174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxr9p" event={"ID":"09e9bd4f-4118-41a1-9106-944dcc312136","Type":"ContainerStarted","Data":"fdf4aa9c1b208ff00e442d948080f499383fe84baa47834f207af247ed7ec185"}
Jul 12 14:45:50.532022 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.531989    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-xhgc5"]
Jul 12 14:45:50.544781 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.544742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:45:50.549008 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.547534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4n82m\""
Jul 12 14:45:50.549008 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.547601    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 14:45:50.549008 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.547809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xhgc5"]
Jul 12 14:45:50.549008 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.547928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 14:45:50.577855 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.577812    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-795ccc884-plldw"]
Jul 12 14:45:50.582533 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.582511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.584613 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.584535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 14:45:50.584752 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.584708    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 14:45:50.584813 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.584773    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 14:45:50.584970 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.584952    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zmjmj\""
Jul 12 14:45:50.591088 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.591062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 14:45:50.601976 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.601955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795ccc884-plldw"]
Jul 12 14:45:50.616595 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85pv\" (UniqueName: \"kubernetes.io/projected/a924f313-e49a-4868-bd09-2b3c84b64b52-kube-api-access-t85pv\") pod \"downloads-68c9cbb497-xhgc5\" (UID: \"a924f313-e49a-4868-bd09-2b3c84b64b52\") " pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:45:50.616719 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-installation-pull-secrets\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616719 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-image-registry-private-configuration\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616719 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-tls\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616719 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-certificates\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616887 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-trusted-ca\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616887 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-ca-trust-extracted\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616887 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-bound-sa-token\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.616887 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.616877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8cw\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-kube-api-access-tn8cw\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85pv\" (UniqueName: \"kubernetes.io/projected/a924f313-e49a-4868-bd09-2b3c84b64b52-kube-api-access-t85pv\") pod \"downloads-68c9cbb497-xhgc5\" (UID: \"a924f313-e49a-4868-bd09-2b3c84b64b52\") " pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:45:50.717596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-installation-pull-secrets\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717842 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-image-registry-private-configuration\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717842 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-tls\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717842 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-certificates\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-trusted-ca\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-ca-trust-extracted\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-bound-sa-token\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.717996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.717944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8cw\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-kube-api-access-tn8cw\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.718348 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.718309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-ca-trust-extracted\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.718948 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.718905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-certificates\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.719176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.719113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-trusted-ca\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.720581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.720547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-installation-pull-secrets\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.720581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.720553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-image-registry-private-configuration\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.720855 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.720836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-registry-tls\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.725889 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.725844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85pv\" (UniqueName: \"kubernetes.io/projected/a924f313-e49a-4868-bd09-2b3c84b64b52-kube-api-access-t85pv\") pod \"downloads-68c9cbb497-xhgc5\" (UID: \"a924f313-e49a-4868-bd09-2b3c84b64b52\") " pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:45:50.725889 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.725866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-bound-sa-token\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.726181 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.726161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8cw\" (UniqueName: \"kubernetes.io/projected/6d7e489a-8b16-4abf-929d-cc4c83dd4db0-kube-api-access-tn8cw\") pod \"image-registry-795ccc884-plldw\" (UID: \"6d7e489a-8b16-4abf-929d-cc4c83dd4db0\") " pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:50.858943 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.858917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:45:50.892740 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:50.892719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:51.006767 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.006730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xhgc5"]
Jul 12 14:45:51.011877 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:45:51.011847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda924f313_e49a_4868_bd09_2b3c84b64b52.slice/crio-11cf8f47e709b2dcf8b1585b43778b6748bb762e68e598628e815dc9044397e9 WatchSource:0}: Error finding container 11cf8f47e709b2dcf8b1585b43778b6748bb762e68e598628e815dc9044397e9: Status 404 returned error can't find the container with id 11cf8f47e709b2dcf8b1585b43778b6748bb762e68e598628e815dc9044397e9
Jul 12 14:45:51.028487 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.028462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795ccc884-plldw"]
Jul 12 14:45:51.031754 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:45:51.031731    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7e489a_8b16_4abf_929d_cc4c83dd4db0.slice/crio-61776d72451e82197233b8b704f3b6b8ba4fb04efd6f60fe8c8ca6fa346084e9 WatchSource:0}: Error finding container 61776d72451e82197233b8b704f3b6b8ba4fb04efd6f60fe8c8ca6fa346084e9: Status 404 returned error can't find the container with id 61776d72451e82197233b8b704f3b6b8ba4fb04efd6f60fe8c8ca6fa346084e9
Jul 12 14:45:51.549098 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.549062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxr9p" event={"ID":"09e9bd4f-4118-41a1-9106-944dcc312136","Type":"ContainerStarted","Data":"7aba56ec22d36320cf9a4ab3437a1969984d11018aacb64e0a6da749f1962853"}
Jul 12 14:45:51.550812 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.550785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795ccc884-plldw" event={"ID":"6d7e489a-8b16-4abf-929d-cc4c83dd4db0","Type":"ContainerStarted","Data":"a4b992e73676feba874dee5544574b3ecd814b211b6a74d4b8b5e982049108c3"}
Jul 12 14:45:51.550957 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.550831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795ccc884-plldw" event={"ID":"6d7e489a-8b16-4abf-929d-cc4c83dd4db0","Type":"ContainerStarted","Data":"61776d72451e82197233b8b704f3b6b8ba4fb04efd6f60fe8c8ca6fa346084e9"}
Jul 12 14:45:51.550957 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.550902    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:45:51.552042 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.552018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xhgc5" event={"ID":"a924f313-e49a-4868-bd09-2b3c84b64b52","Type":"ContainerStarted","Data":"11cf8f47e709b2dcf8b1585b43778b6748bb762e68e598628e815dc9044397e9"}
Jul 12 14:45:51.565423 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.565194    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxr9p" podStartSLOduration=17.764717859 podStartE2EDuration="24.565175772s" totalImagesPullingTime="6.800457913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 14:45:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:45:51.564943922 +0000 UTC m=+278.455088711" watchObservedRunningTime="2026-07-12 14:45:51.565175772 +0000 UTC m=+278.455320557"
Jul 12 14:45:51.583974 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:51.583923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-795ccc884-plldw" podStartSLOduration=1.583903678 podStartE2EDuration="1.583903678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:45:51.583287092 +0000 UTC m=+278.473431881" watchObservedRunningTime="2026-07-12 14:45:51.583903678 +0000 UTC m=+278.474048470"
Jul 12 14:45:55.213549 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:45:55.213499    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6qw5w" podUID="ccdf7363-d0da-432d-95f2-68e8aa96527f"
Jul 12 14:45:55.565701 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:55.565673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:45:58.251173 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.251115    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" podUID="0733a63c-d9cf-41b7-96e8-8f54b4c3fd63" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 14:45:58.477186 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.477155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:45:58.479635 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.479608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccdf7363-d0da-432d-95f2-68e8aa96527f-metrics-tls\") pod \"dns-default-6qw5w\" (UID: \"ccdf7363-d0da-432d-95f2-68e8aa96527f\") " pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:45:58.568883 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.568848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff579\""
Jul 12 14:45:58.577460 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.577432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:45:58.720519 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:58.720488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qw5w"]
Jul 12 14:45:58.724163 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:45:58.724112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdf7363_d0da_432d_95f2_68e8aa96527f.slice/crio-292e39259c28f567ec7dcbc7213c7bf0e9f1656d554ad52f71751de830e1d094 WatchSource:0}: Error finding container 292e39259c28f567ec7dcbc7213c7bf0e9f1656d554ad52f71751de830e1d094: Status 404 returned error can't find the container with id 292e39259c28f567ec7dcbc7213c7bf0e9f1656d554ad52f71751de830e1d094
Jul 12 14:45:59.579861 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:45:59.579826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qw5w" event={"ID":"ccdf7363-d0da-432d-95f2-68e8aa96527f","Type":"ContainerStarted","Data":"292e39259c28f567ec7dcbc7213c7bf0e9f1656d554ad52f71751de830e1d094"}
Jul 12 14:46:07.606642 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:46:07.606594    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q4pl4" podUID="45d028c1-3064-40db-9cdc-a0063eae53d4"
Jul 12 14:46:08.250565 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.250468    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" podUID="0733a63c-d9cf-41b7-96e8-8f54b4c3fd63" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 14:46:08.250565 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.250562    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg"
Jul 12 14:46:08.251213 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.251171    2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ea81e752816dca95fdf302cb2dc9ac7ab0c52dbe13b9c0c84e14ea6411d8f29f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 12 14:46:08.251338 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.251232    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" podUID="0733a63c-d9cf-41b7-96e8-8f54b4c3fd63" containerName="service-proxy" containerID="cri-o://ea81e752816dca95fdf302cb2dc9ac7ab0c52dbe13b9c0c84e14ea6411d8f29f" gracePeriod=30
Jul 12 14:46:08.618211 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.618169    2581 generic.go:356] "Generic (PLEG): container finished" podID="0733a63c-d9cf-41b7-96e8-8f54b4c3fd63" containerID="ea81e752816dca95fdf302cb2dc9ac7ab0c52dbe13b9c0c84e14ea6411d8f29f" exitCode=2
Jul 12 14:46:08.618688 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.618251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerDied","Data":"ea81e752816dca95fdf302cb2dc9ac7ab0c52dbe13b9c0c84e14ea6411d8f29f"}
Jul 12 14:46:08.618688 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.618301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77bdb859f4-pzfqg" event={"ID":"0733a63c-d9cf-41b7-96e8-8f54b4c3fd63","Type":"ContainerStarted","Data":"a0193db79e210dba567e608f7e8439c3034d58178eb46588ab222603c438c049"}
Jul 12 14:46:08.620162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.620114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xhgc5" event={"ID":"a924f313-e49a-4868-bd09-2b3c84b64b52","Type":"ContainerStarted","Data":"aa4d2dfed8c45794ed2e5236e058e5525314e88a5066ad3ca0ee596251eb52aa"}
Jul 12 14:46:08.620309 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.620289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:46:08.622331 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.622306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qw5w" event={"ID":"ccdf7363-d0da-432d-95f2-68e8aa96527f","Type":"ContainerStarted","Data":"5b4fc32a2c881026664d4cb35c8eba8d6477753984ad7b00d4282f5deb9ba254"}
Jul 12 14:46:08.622526 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.622510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qw5w" event={"ID":"ccdf7363-d0da-432d-95f2-68e8aa96527f","Type":"ContainerStarted","Data":"d2846eaf400af268e5bd7b6d8be5cf79abb9240a36085996f18c7817d1f6d2ee"}
Jul 12 14:46:08.622614 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.622595    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:46:08.633847 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.633819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-xhgc5"
Jul 12 14:46:08.650438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.650391    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-xhgc5" podStartSLOduration=2.029949072 podStartE2EDuration="18.650371995s" totalImagesPullingTime="16.620422923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:08.6493252 +0000 UTC m=+295.539469986" watchObservedRunningTime="2026-07-12 14:46:08.650371995 +0000 UTC m=+295.540516777"
Jul 12 14:46:08.664939 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:08.664886    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6qw5w" podStartSLOduration=251.63360261 podStartE2EDuration="4m20.664865259s" totalImagesPullingTime="9.031262649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:08.66386076 +0000 UTC m=+295.554005545" watchObservedRunningTime="2026-07-12 14:46:08.664865259 +0000 UTC m=+295.555010044"
Jul 12 14:46:11.728373 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.728337    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"]
Jul 12 14:46:11.759402 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.759370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"]
Jul 12 14:46:11.759547 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.759424    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mr75f"]
Jul 12 14:46:11.759547 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.759523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.765601 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.765575    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 14:46:11.765740 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.765628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fm95q\""
Jul 12 14:46:11.766585 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.766493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 12 14:46:11.766585 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.766514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 12 14:46:11.766585 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.766573    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 14:46:11.766931 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.766912    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 14:46:11.777659 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.777639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.780417 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.780397    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 12 14:46:11.780558 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.780457    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 12 14:46:11.780788 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.780771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vwtt7\""
Jul 12 14:46:11.784869 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.784843    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qnn6m"]
Jul 12 14:46:11.787162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.787142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 12 14:46:11.807727 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.807696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mr75f"]
Jul 12 14:46:11.807895 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.807839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.810501 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.810478    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 14:46:11.810646 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.810528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mbqzh\""
Jul 12 14:46:11.811000 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.810977    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 14:46:11.811106 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.810977    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 14:46:11.881953 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.881923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.882177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.881964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.881993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-textfile\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-wtmp\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-root\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-sys\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxncg\" (UniqueName: \"kubernetes.io/projected/a2e954e4-e706-4ad2-9058-4584b28922f8-kube-api-access-rxncg\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlrx\" (UniqueName: \"kubernetes.io/projected/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-api-access-ghlrx\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6xt\" (UniqueName: \"kubernetes.io/projected/5c88434e-2128-4c6d-999c-48563ec53e41-kube-api-access-dt6xt\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-metrics-client-ca\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbea8432-c428-48f6-ad6c-c1015d22439b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.882664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.882592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88434e-2128-4c6d-999c-48563ec53e41-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.983905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.983809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxncg\" (UniqueName: \"kubernetes.io/projected/a2e954e4-e706-4ad2-9058-4584b28922f8-kube-api-access-rxncg\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.983905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.983862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlrx\" (UniqueName: \"kubernetes.io/projected/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-api-access-ghlrx\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.983905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.983902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6xt\" (UniqueName: \"kubernetes.io/projected/5c88434e-2128-4c6d-999c-48563ec53e41-kube-api-access-dt6xt\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.983930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.983960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-metrics-client-ca\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbea8432-c428-48f6-ad6c-c1015d22439b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88434e-2128-4c6d-999c-48563ec53e41-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-textfile\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-wtmp\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.984345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-root\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-sys\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-sys\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:46:11.984706    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:46:11.984770    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls podName:a2e954e4-e706-4ad2-9058-4584b28922f8 nodeName:}" failed. No retries permitted until 2026-07-12 14:46:12.484751308 +0000 UTC m=+299.374896088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls") pod "node-exporter-qnn6m" (UID: "a2e954e4-e706-4ad2-9058-4584b28922f8") : secret "node-exporter-tls" not found
Jul 12 14:46:11.985020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.984975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-wtmp\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e954e4-e706-4ad2-9058-4584b28922f8-metrics-client-ca\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2e954e4-e706-4ad2-9058-4584b28922f8-root\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985367 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-textfile\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.985616 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:46:11.985391    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 12 14:46:11.985616 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:46:11.985465    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls podName:5c88434e-2128-4c6d-999c-48563ec53e41 nodeName:}" failed. No retries permitted until 2026-07-12 14:46:12.48544842 +0000 UTC m=+299.375593186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-f2467" (UID: "5c88434e-2128-4c6d-999c-48563ec53e41") : secret "openshift-state-metrics-tls" not found
Jul 12 14:46:11.985720 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbea8432-c428-48f6-ad6c-c1015d22439b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.985720 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c88434e-2128-4c6d-999c-48563ec53e41-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.985812 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.986063 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.985875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbea8432-c428-48f6-ad6c-c1015d22439b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.988231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.988085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:11.988231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.988149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.988542 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.988518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.989750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.989720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:11.995355 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.995308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlrx\" (UniqueName: \"kubernetes.io/projected/dbea8432-c428-48f6-ad6c-c1015d22439b-kube-api-access-ghlrx\") pod \"kube-state-metrics-785778ff74-mr75f\" (UID: \"dbea8432-c428-48f6-ad6c-c1015d22439b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:11.996000 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:11.995957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6xt\" (UniqueName: \"kubernetes.io/projected/5c88434e-2128-4c6d-999c-48563ec53e41-kube-api-access-dt6xt\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:12.003321 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.003275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxncg\" (UniqueName: \"kubernetes.io/projected/a2e954e4-e706-4ad2-9058-4584b28922f8-kube-api-access-rxncg\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:12.088137 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.088099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f"
Jul 12 14:46:12.271729 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.271533    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mr75f"]
Jul 12 14:46:12.274528 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:46:12.274496    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbea8432_c428_48f6_ad6c_c1015d22439b.slice/crio-4a95ee53b5ce0c489651375cf95d2e3e395bd96c4cd646b61adafcc095ab917e WatchSource:0}: Error finding container 4a95ee53b5ce0c489651375cf95d2e3e395bd96c4cd646b61adafcc095ab917e: Status 404 returned error can't find the container with id 4a95ee53b5ce0c489651375cf95d2e3e395bd96c4cd646b61adafcc095ab917e
Jul 12 14:46:12.487848 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.487804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:12.488028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.487898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:12.490549 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.490519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2e954e4-e706-4ad2-9058-4584b28922f8-node-exporter-tls\") pod \"node-exporter-qnn6m\" (UID: \"a2e954e4-e706-4ad2-9058-4584b28922f8\") " pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:12.490676 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.490577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c88434e-2128-4c6d-999c-48563ec53e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f2467\" (UID: \"5c88434e-2128-4c6d-999c-48563ec53e41\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:12.560182 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.560153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-795ccc884-plldw"
Jul 12 14:46:12.638280 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.638241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f" event={"ID":"dbea8432-c428-48f6-ad6c-c1015d22439b","Type":"ContainerStarted","Data":"4a95ee53b5ce0c489651375cf95d2e3e395bd96c4cd646b61adafcc095ab917e"}
Jul 12 14:46:12.670711 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.670670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"
Jul 12 14:46:12.718330 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.718295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qnn6m"
Jul 12 14:46:12.748542 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:46:12.748491    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e954e4_e706_4ad2_9058_4584b28922f8.slice/crio-40ecfe3184383111fc671677b6e81922204f9218c11db8d994062b281d3c0feb WatchSource:0}: Error finding container 40ecfe3184383111fc671677b6e81922204f9218c11db8d994062b281d3c0feb: Status 404 returned error can't find the container with id 40ecfe3184383111fc671677b6e81922204f9218c11db8d994062b281d3c0feb
Jul 12 14:46:12.830546 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.830466    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 14:46:12.847422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.845888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.847422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.846483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.848853    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.849562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f2467"]
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.849892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.850142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.850331    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.850534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.850710    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cc4nc\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.850875    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.851112    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.851181    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 12 14:46:12.853741 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.852272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 12 14:46:12.856655 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:46:12.856003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c88434e_2128_4c6d_999c_48563ec53e41.slice/crio-eccf8a9ddc4aad074b1357eacca826e0b2fa4c239eff567a94f2f378ebb83217 WatchSource:0}: Error finding container eccf8a9ddc4aad074b1357eacca826e0b2fa4c239eff567a94f2f378ebb83217: Status 404 returned error can't find the container with id eccf8a9ddc4aad074b1357eacca826e0b2fa4c239eff567a94f2f378ebb83217
Jul 12 14:46:12.993829 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.993996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.993996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-web-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.993996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxv7\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-kube-api-access-wlxv7\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.993996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.993996 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.993977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-config-out\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:12.994290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:12.994224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-web-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxv7\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-kube-api-access-wlxv7\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-config-out\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.095798 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.096064 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.095804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.097844 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.097815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.098752 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.098725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1640320-e72c-444c-afb2-ca29c61048b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.102886 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.102523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.104980 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.104897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.108040 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.107678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.108040 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.107998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1640320-e72c-444c-afb2-ca29c61048b7-config-out\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.108800 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.108217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.108800 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.108633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-web-config\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.108800 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.108646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.109088 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.109064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.109578 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.109515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.109651 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.109580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1640320-e72c-444c-afb2-ca29c61048b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.111749 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.111720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxv7\" (UniqueName: \"kubernetes.io/projected/a1640320-e72c-444c-afb2-ca29c61048b7-kube-api-access-wlxv7\") pod \"alertmanager-main-0\" (UID: \"a1640320-e72c-444c-afb2-ca29c61048b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.164727 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.164495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 14:46:13.400854 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.400677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 14:46:13.404633 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:46:13.404598    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1640320_e72c_444c_afb2_ca29c61048b7.slice/crio-9c7ff97f99cca20f6e0eb6ca27962dd122ef8f22754a5ec0fc70a71e186cdffd WatchSource:0}: Error finding container 9c7ff97f99cca20f6e0eb6ca27962dd122ef8f22754a5ec0fc70a71e186cdffd: Status 404 returned error can't find the container with id 9c7ff97f99cca20f6e0eb6ca27962dd122ef8f22754a5ec0fc70a71e186cdffd
Jul 12 14:46:13.481864 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.481841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:46:13.482888 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.482808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:46:13.493398 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.493314    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 14:46:13.650630 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.650448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"9c7ff97f99cca20f6e0eb6ca27962dd122ef8f22754a5ec0fc70a71e186cdffd"}
Jul 12 14:46:14.073041 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.652007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnn6m" event={"ID":"a2e954e4-e706-4ad2-9058-4584b28922f8","Type":"ContainerStarted","Data":"40ecfe3184383111fc671677b6e81922204f9218c11db8d994062b281d3c0feb"}
Jul 12 14:46:14.073041 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.654108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467" event={"ID":"5c88434e-2128-4c6d-999c-48563ec53e41","Type":"ContainerStarted","Data":"d9aa59a96fa4301a0e9aa665222260507428598cfca0bbb7fc97edaf1a6f526a"}
Jul 12 14:46:14.073041 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.654177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467" event={"ID":"5c88434e-2128-4c6d-999c-48563ec53e41","Type":"ContainerStarted","Data":"b771d6da6879a4a45953f8126d617f3d201cb812575758944acac047cde03881"}
Jul 12 14:46:14.073041 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:13.654208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467" event={"ID":"5c88434e-2128-4c6d-999c-48563ec53e41","Type":"ContainerStarted","Data":"eccf8a9ddc4aad074b1357eacca826e0b2fa4c239eff567a94f2f378ebb83217"}
Jul 12 14:46:15.664473 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:15.664373    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2e954e4-e706-4ad2-9058-4584b28922f8" containerID="f10e5dcd55b080581e81a09c612d6c388335f63a060468900f7cbea4518bc199" exitCode=0
Jul 12 14:46:15.664473 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:15.664455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnn6m" event={"ID":"a2e954e4-e706-4ad2-9058-4584b28922f8","Type":"ContainerDied","Data":"f10e5dcd55b080581e81a09c612d6c388335f63a060468900f7cbea4518bc199"}
Jul 12 14:46:15.666244 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:15.666219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f" event={"ID":"dbea8432-c428-48f6-ad6c-c1015d22439b","Type":"ContainerStarted","Data":"5b457af33c1737fd412bab53c53a1d2a3ec71b1aaf71fcdd115d8f3816372310"}
Jul 12 14:46:16.076469 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.076423    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67bd849d4f-vznfd"]
Jul 12 14:46:16.100988 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.100956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67bd849d4f-vznfd"]
Jul 12 14:46:16.101198 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.101104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.103688 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.103662    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 14:46:16.103825 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.103709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 12 14:46:16.103825 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.103756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d9pcx\""
Jul 12 14:46:16.104721 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.104700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ds3q8qj7ug8c2\""
Jul 12 14:46:16.105020 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.104784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 12 14:46:16.105137 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.104803    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 12 14:46:16.240822 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.240795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-tls\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.240951 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.240849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4htl\" (UniqueName: \"kubernetes.io/projected/356e7cb6-0762-4aaf-b320-16701213854b-kube-api-access-p4htl\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.241009 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.240959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-client-certs\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.241065 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.241030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/356e7cb6-0762-4aaf-b320-16701213854b-audit-log\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.241065 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.241060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-metrics-server-audit-profiles\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.241184 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.241089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.241184 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.241113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-client-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.341816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/356e7cb6-0762-4aaf-b320-16701213854b-audit-log\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.341858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-metrics-server-audit-profiles\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.341890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.341919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-client-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.341967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-tls\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.342001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4htl\" (UniqueName: \"kubernetes.io/projected/356e7cb6-0762-4aaf-b320-16701213854b-kube-api-access-p4htl\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.342036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-client-certs\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.342516 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.342338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/356e7cb6-0762-4aaf-b320-16701213854b-audit-log\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.343362 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.343296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.343555 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.343526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/356e7cb6-0762-4aaf-b320-16701213854b-metrics-server-audit-profiles\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.346183 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.345661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-tls\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.346183 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.345820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-client-ca-bundle\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.346183 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.346114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/356e7cb6-0762-4aaf-b320-16701213854b-secret-metrics-server-client-certs\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.351952 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.351848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4htl\" (UniqueName: \"kubernetes.io/projected/356e7cb6-0762-4aaf-b320-16701213854b-kube-api-access-p4htl\") pod \"metrics-server-67bd849d4f-vznfd\" (UID: \"356e7cb6-0762-4aaf-b320-16701213854b\") " pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.412279 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.412252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:16.611328 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.611233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67bd849d4f-vznfd"]
Jul 12 14:46:16.614093 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:46:16.614056    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356e7cb6_0762_4aaf_b320_16701213854b.slice/crio-9b5d0ecc60d7bb07dbd5f9024fc85422d2302c5dd111e8e9c6447002b9195429 WatchSource:0}: Error finding container 9b5d0ecc60d7bb07dbd5f9024fc85422d2302c5dd111e8e9c6447002b9195429: Status 404 returned error can't find the container with id 9b5d0ecc60d7bb07dbd5f9024fc85422d2302c5dd111e8e9c6447002b9195429
Jul 12 14:46:16.616797 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.616780    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 14:46:16.673385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.672757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f" event={"ID":"dbea8432-c428-48f6-ad6c-c1015d22439b","Type":"ContainerStarted","Data":"1badba581e81e4a7a201311ee2abd3432908521cc8a2f6cc466f592246dea45d"}
Jul 12 14:46:16.673385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.672827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f" event={"ID":"dbea8432-c428-48f6-ad6c-c1015d22439b","Type":"ContainerStarted","Data":"bdd321ed7ec24c4c34e3fe658a256060829ed8fa470e5336c397d61cf654643f"}
Jul 12 14:46:16.674629 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.674596    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1640320-e72c-444c-afb2-ca29c61048b7" containerID="6325e67b8c131e9e209297adec8f70519391810182b77a483b8d07941260b4f3" exitCode=0
Jul 12 14:46:16.674746 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.674689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerDied","Data":"6325e67b8c131e9e209297adec8f70519391810182b77a483b8d07941260b4f3"}
Jul 12 14:46:16.676226 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.676205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd" event={"ID":"356e7cb6-0762-4aaf-b320-16701213854b","Type":"ContainerStarted","Data":"9b5d0ecc60d7bb07dbd5f9024fc85422d2302c5dd111e8e9c6447002b9195429"}
Jul 12 14:46:16.679249 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.679225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnn6m" event={"ID":"a2e954e4-e706-4ad2-9058-4584b28922f8","Type":"ContainerStarted","Data":"6571578a000b10f866d66845f6c237e12a31fb39103dce87464f14c90e9aea73"}
Jul 12 14:46:16.679361 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.679274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnn6m" event={"ID":"a2e954e4-e706-4ad2-9058-4584b28922f8","Type":"ContainerStarted","Data":"667f7b1dd4c224f3977461a0da472d818d72755d05178497b29b98a7d5b4167f"}
Jul 12 14:46:16.681549 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.681525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467" event={"ID":"5c88434e-2128-4c6d-999c-48563ec53e41","Type":"ContainerStarted","Data":"cd2b43b74f254b20dcc115ff73e106cf1c62b8359f9c124cbb312115ade008f1"}
Jul 12 14:46:16.693175 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.693098    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-mr75f" podStartSLOduration=3.223079037 podStartE2EDuration="5.693078933s" totalImagesPullingTime="2.469999896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:16.692774752 +0000 UTC m=+303.582919540" watchObservedRunningTime="2026-07-12 14:46:16.693078933 +0000 UTC m=+303.583223718"
Jul 12 14:46:16.709260 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.709212    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f2467" podStartSLOduration=2.6280130699999997 podStartE2EDuration="5.709191954s" totalImagesPullingTime="3.081178884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:16.709179907 +0000 UTC m=+303.599324690" watchObservedRunningTime="2026-07-12 14:46:16.709191954 +0000 UTC m=+303.599336732"
Jul 12 14:46:16.752672 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:16.752490    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qnn6m" podStartSLOduration=3.5944921770000002 podStartE2EDuration="5.752469783s" totalImagesPullingTime="2.001890766s" totalInitContainerRuntime="156.08684ms" isStatefulPod=true podCreationTimestamp="2026-07-12 14:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:16.750097807 +0000 UTC m=+303.640242594" watchObservedRunningTime="2026-07-12 14:46:16.752469783 +0000 UTC m=+303.642614570"
Jul 12 14:46:18.628414 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:18.628377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6qw5w"
Jul 12 14:46:19.696986 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.696894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"ca39cfb3123599253d020f5fb4609f9f38dedb17ec27223c28620f12b2c079af"}
Jul 12 14:46:19.696986 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.696965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"bb6da08cbeedf310ad4634bfe38f783dd35d8dff6be4342eb1fd5df0c31cefe3"}
Jul 12 14:46:19.697540 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.697004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"48ed64a35402c9b71ad781f88a29f5a88f4b95c952c560ce3ed99d53eb0b354a"}
Jul 12 14:46:19.697540 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.697037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"093baa7824f643f647162e23366ea208a18bb42a7509c244d9f5fd3ed3803667"}
Jul 12 14:46:19.697540 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.697061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"2e38adbe84ee733d9b6507bc32895a41421057e5950a9f747ac7fada6116fac4"}
Jul 12 14:46:19.698433 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.698413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd" event={"ID":"356e7cb6-0762-4aaf-b320-16701213854b","Type":"ContainerStarted","Data":"e0c5c6124902ebe5712b4234085aa8e23362f0d2f6c3a33656eb6f01c7e2c103"}
Jul 12 14:46:19.714941 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:19.714895    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd" podStartSLOduration=1.437232074 podStartE2EDuration="3.714877079s" totalImagesPullingTime="2.277645005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:19.713654995 +0000 UTC m=+306.603799782" watchObservedRunningTime="2026-07-12 14:46:19.714877079 +0000 UTC m=+306.605021863"
Jul 12 14:46:21.707816 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:21.707780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1640320-e72c-444c-afb2-ca29c61048b7","Type":"ContainerStarted","Data":"27a8b8b77997f3978f8e8ea333a92eda3a3f18ce8748e008ec34e95800859975"}
Jul 12 14:46:21.733227 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:21.733175    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.516857902 podStartE2EDuration="9.733154076s" totalImagesPullingTime="6.194574477s" totalInitContainerRuntime="21.721697ms" isStatefulPod=false podCreationTimestamp="2026-07-12 14:46:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:46:21.732817254 +0000 UTC m=+308.622962041" watchObservedRunningTime="2026-07-12 14:46:21.733154076 +0000 UTC m=+308.623298861"
Jul 12 14:46:22.605109 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:22.605077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:46:36.413178 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:36.413116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:36.413651 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:36.413216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:56.417832 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:56.417803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:46:56.421672 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:46:56.421647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67bd849d4f-vznfd"
Jul 12 14:47:27.433738 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.433631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:47:27.436068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.436042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45d028c1-3064-40db-9cdc-a0063eae53d4-metrics-certs\") pod \"network-metrics-daemon-q4pl4\" (UID: \"45d028c1-3064-40db-9cdc-a0063eae53d4\") " pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:47:27.708198 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.708104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6tgvw\""
Jul 12 14:47:27.716758 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.716731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4pl4"
Jul 12 14:47:27.840782 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.840755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4pl4"]
Jul 12 14:47:27.843402 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:47:27.843370    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d028c1_3064_40db_9cdc_a0063eae53d4.slice/crio-231bc364b45a3c1e77716dd1cddf0d6b549367209b4e02a6d6f4de4072fae926 WatchSource:0}: Error finding container 231bc364b45a3c1e77716dd1cddf0d6b549367209b4e02a6d6f4de4072fae926: Status 404 returned error can't find the container with id 231bc364b45a3c1e77716dd1cddf0d6b549367209b4e02a6d6f4de4072fae926
Jul 12 14:47:27.942884 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:27.942850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4pl4" event={"ID":"45d028c1-3064-40db-9cdc-a0063eae53d4","Type":"ContainerStarted","Data":"231bc364b45a3c1e77716dd1cddf0d6b549367209b4e02a6d6f4de4072fae926"}
Jul 12 14:47:28.948592 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:28.948551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4pl4" event={"ID":"45d028c1-3064-40db-9cdc-a0063eae53d4","Type":"ContainerStarted","Data":"58f8c4db5773e501a3e8db24b6e43d001ab527c84a3d85f637895be06770317a"}
Jul 12 14:47:28.949038 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:28.948620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4pl4" event={"ID":"45d028c1-3064-40db-9cdc-a0063eae53d4","Type":"ContainerStarted","Data":"25792cf3d049badc06f953b33cff1d23b76cc954cf485f280f332a22f94eb658"}
Jul 12 14:47:28.963866 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:47:28.963816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q4pl4" podStartSLOduration=375.056052815 podStartE2EDuration="6m15.963800639s" totalImagesPullingTime="907.747824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:47:28.96224482 +0000 UTC m=+375.852389615" watchObservedRunningTime="2026-07-12 14:47:28.963800639 +0000 UTC m=+375.853945424"
Jul 12 14:48:59.391176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.391138    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcckh"]
Jul 12 14:48:59.393334 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.393315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.395284 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.395264    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 14:48:59.395379 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.395311    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 14:48:59.395829 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.395814    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ntbvw\""
Jul 12 14:48:59.403649 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.403630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcckh"]
Jul 12 14:48:59.502872 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.502842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.503046 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.502901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sk54\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-kube-api-access-6sk54\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.603723 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.603690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sk54\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-kube-api-access-6sk54\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.603920 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.603739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.611743 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.611715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.611743 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.611741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sk54\" (UniqueName: \"kubernetes.io/projected/f248cdb8-d800-46db-94d8-064276dc4ba4-kube-api-access-6sk54\") pod \"cert-manager-55b4d954d5-wcckh\" (UID: \"f248cdb8-d800-46db-94d8-064276dc4ba4\") " pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.702457 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.702383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wcckh"
Jul 12 14:48:59.824232 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:48:59.824201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcckh"]
Jul 12 14:48:59.827288 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:48:59.827261    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf248cdb8_d800_46db_94d8_064276dc4ba4.slice/crio-cabcd579f861289c4542d79e68c6b6577107fea254150bc2d7901f8bc3a2997c WatchSource:0}: Error finding container cabcd579f861289c4542d79e68c6b6577107fea254150bc2d7901f8bc3a2997c: Status 404 returned error can't find the container with id cabcd579f861289c4542d79e68c6b6577107fea254150bc2d7901f8bc3a2997c
Jul 12 14:49:00.286186 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:00.286151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wcckh" event={"ID":"f248cdb8-d800-46db-94d8-064276dc4ba4","Type":"ContainerStarted","Data":"cabcd579f861289c4542d79e68c6b6577107fea254150bc2d7901f8bc3a2997c"}
Jul 12 14:49:03.300808 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:03.300766    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wcckh" event={"ID":"f248cdb8-d800-46db-94d8-064276dc4ba4","Type":"ContainerStarted","Data":"bdb052758ff2bb1048de238aa36c5d6db2a21099763668ef69d9ca747beab97c"}
Jul 12 14:49:03.315449 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:03.315395    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wcckh" podStartSLOduration=1.470039505 podStartE2EDuration="4.315379274s" totalImagesPullingTime="2.845339769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:03.313959975 +0000 UTC m=+470.204104772" watchObservedRunningTime="2026-07-12 14:49:03.315379274 +0000 UTC m=+470.205524059"
Jul 12 14:49:18.669783 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.669737    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"]
Jul 12 14:49:18.672058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.672040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.675028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.675004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 14:49:18.675162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.675027    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 14:49:18.675162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.675117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 14:49:18.675162 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.675143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 14:49:18.675325 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.675181    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ffwdm\""
Jul 12 14:49:18.693082 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.693052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"]
Jul 12 14:49:18.756970 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.756935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.757159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.756991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.757159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.757035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.757159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.757056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.757159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.757119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqbnr\" (UniqueName: \"kubernetes.io/projected/46b73fb3-0757-4aa7-81ff-155cfa053a02-kube-api-access-gqbnr\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858072 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858072 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858340 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqbnr\" (UniqueName: \"kubernetes.io/projected/46b73fb3-0757-4aa7-81ff-155cfa053a02-kube-api-access-gqbnr\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858340 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858340 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.858493 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.858463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.860585 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.860559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b73fb3-0757-4aa7-81ff-155cfa053a02-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.860775 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.860755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.860818 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.860760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46b73fb3-0757-4aa7-81ff-155cfa053a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.869240 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.869184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqbnr\" (UniqueName: \"kubernetes.io/projected/46b73fb3-0757-4aa7-81ff-155cfa053a02-kube-api-access-gqbnr\") pod \"opendatahub-operator-controller-manager-6d4d9f5575-rcpjs\" (UID: \"46b73fb3-0757-4aa7-81ff-155cfa053a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:18.982936 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:18.982842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:19.116384 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:19.116342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"]
Jul 12 14:49:19.119676 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:19.119641    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b73fb3_0757_4aa7_81ff_155cfa053a02.slice/crio-2638dd1f5e674ec3604b68b91731e271fde228670a98b477d0bb5d6b34a53418 WatchSource:0}: Error finding container 2638dd1f5e674ec3604b68b91731e271fde228670a98b477d0bb5d6b34a53418: Status 404 returned error can't find the container with id 2638dd1f5e674ec3604b68b91731e271fde228670a98b477d0bb5d6b34a53418
Jul 12 14:49:19.362812 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:19.362778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs" event={"ID":"46b73fb3-0757-4aa7-81ff-155cfa053a02","Type":"ContainerStarted","Data":"2638dd1f5e674ec3604b68b91731e271fde228670a98b477d0bb5d6b34a53418"}
Jul 12 14:49:22.377980 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:22.377945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs" event={"ID":"46b73fb3-0757-4aa7-81ff-155cfa053a02","Type":"ContainerStarted","Data":"370c3ebb7fd6035d1c311b2b9367727c0bfa917840bb2c6df968fa42709bb0f4"}
Jul 12 14:49:23.383683 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:23.383593    2581 generic.go:356] "Generic (PLEG): container finished" podID="46b73fb3-0757-4aa7-81ff-155cfa053a02" containerID="370c3ebb7fd6035d1c311b2b9367727c0bfa917840bb2c6df968fa42709bb0f4" exitCode=0
Jul 12 14:49:23.383683 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:23.383644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs" event={"ID":"46b73fb3-0757-4aa7-81ff-155cfa053a02","Type":"ContainerDied","Data":"370c3ebb7fd6035d1c311b2b9367727c0bfa917840bb2c6df968fa42709bb0f4"}
Jul 12 14:49:24.389342 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:24.389308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs" event={"ID":"46b73fb3-0757-4aa7-81ff-155cfa053a02","Type":"ContainerStarted","Data":"6df07e5a577f9da4ec6bc44b7319243867b38f8bdb1ebbfbf4d7ba017adfab4d"}
Jul 12 14:49:24.389750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:24.389428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:24.408811 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:24.408757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs" podStartSLOduration=2.142744924 podStartE2EDuration="6.408737904s" totalImagesPullingTime="3.178263889s" totalInitContainerRuntime="1.087729091s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:24.407932151 +0000 UTC m=+491.298076946" watchObservedRunningTime="2026-07-12 14:49:24.408737904 +0000 UTC m=+491.298882688"
Jul 12 14:49:35.396379 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:35.396342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9f5575-rcpjs"
Jul 12 14:49:38.299063 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.299036    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"]
Jul 12 14:49:38.359064 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.359033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"]
Jul 12 14:49:38.359244 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.359173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.362465 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.362436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 14:49:38.362985 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.362972    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 14:49:38.363035 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.362983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 14:49:38.363742 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.363715    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l5qxl\""
Jul 12 14:49:38.363742 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.363728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 14:49:38.416121 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.416082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed005c91-511e-4fcb-b957-be442cbbb14a-tmp\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.416322 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.416155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed005c91-511e-4fcb-b957-be442cbbb14a-tls-certs\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.416322 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.416186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/ed005c91-511e-4fcb-b957-be442cbbb14a-kube-api-access-c7tt5\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.516992 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.516957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed005c91-511e-4fcb-b957-be442cbbb14a-tls-certs\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.516992 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.516995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/ed005c91-511e-4fcb-b957-be442cbbb14a-kube-api-access-c7tt5\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.517224 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.517079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed005c91-511e-4fcb-b957-be442cbbb14a-tmp\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.519474 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.519448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed005c91-511e-4fcb-b957-be442cbbb14a-tmp\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.519653 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.519632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed005c91-511e-4fcb-b957-be442cbbb14a-tls-certs\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.528891 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.528869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/ed005c91-511e-4fcb-b957-be442cbbb14a-kube-api-access-c7tt5\") pod \"kube-auth-proxy-6b855bfc69-vqmj8\" (UID: \"ed005c91-511e-4fcb-b957-be442cbbb14a\") " pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.556386 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.556315    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksk9w"]
Jul 12 14:49:38.583564 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.583539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksk9w"]
Jul 12 14:49:38.583707 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.583633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:38.585691 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.585670    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 12 14:49:38.585752 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.585731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bd7xs\""
Jul 12 14:49:38.668581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.668549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"
Jul 12 14:49:38.718385 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.718343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffb57\" (UniqueName: \"kubernetes.io/projected/f1f49965-42f2-44da-8363-2bad3b549939-kube-api-access-ffb57\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:38.718552 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.718413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:38.819228 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.819188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffb57\" (UniqueName: \"kubernetes.io/projected/f1f49965-42f2-44da-8363-2bad3b549939-kube-api-access-ffb57\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:38.819395 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.819252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:38.819441 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:38.819386    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 12 14:49:38.819474 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:38.819460    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert podName:f1f49965-42f2-44da-8363-2bad3b549939 nodeName:}" failed. No retries permitted until 2026-07-12 14:49:39.319443994 +0000 UTC m=+506.209588761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert") pod "odh-model-controller-7998c67dc4-ksk9w" (UID: "f1f49965-42f2-44da-8363-2bad3b549939") : secret "odh-model-controller-webhook-cert" not found
Jul 12 14:49:38.829524 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.829492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8"]
Jul 12 14:49:38.832556 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:38.832528    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded005c91_511e_4fcb_b957_be442cbbb14a.slice/crio-7de0b9289e7a907677165fb91ffcd752d3a53dae1ab4db8f23eb586a6b5c3d1f WatchSource:0}: Error finding container 7de0b9289e7a907677165fb91ffcd752d3a53dae1ab4db8f23eb586a6b5c3d1f: Status 404 returned error can't find the container with id 7de0b9289e7a907677165fb91ffcd752d3a53dae1ab4db8f23eb586a6b5c3d1f
Jul 12 14:49:38.834258 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:38.834240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffb57\" (UniqueName: \"kubernetes.io/projected/f1f49965-42f2-44da-8363-2bad3b549939-kube-api-access-ffb57\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:39.324528 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.324495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:39.327031 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.327007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1f49965-42f2-44da-8363-2bad3b549939-cert\") pod \"odh-model-controller-7998c67dc4-ksk9w\" (UID: \"f1f49965-42f2-44da-8363-2bad3b549939\") " pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:39.455497 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.455457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8" event={"ID":"ed005c91-511e-4fcb-b957-be442cbbb14a","Type":"ContainerStarted","Data":"7de0b9289e7a907677165fb91ffcd752d3a53dae1ab4db8f23eb586a6b5c3d1f"}
Jul 12 14:49:39.495034 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.494964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:39.651737 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.651700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ksk9w"]
Jul 12 14:49:39.655298 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:39.655263    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f49965_42f2_44da_8363_2bad3b549939.slice/crio-171282007b5447c1ee0c510d6f4b94a1f5552c43f1b427079c310cac401d8123 WatchSource:0}: Error finding container 171282007b5447c1ee0c510d6f4b94a1f5552c43f1b427079c310cac401d8123: Status 404 returned error can't find the container with id 171282007b5447c1ee0c510d6f4b94a1f5552c43f1b427079c310cac401d8123
Jul 12 14:49:39.667676 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.667651    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:39.670941 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.670919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.673289 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.673263    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 14:49:39.673289 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.673277    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 14:49:39.674051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.673814    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 14:49:39.674051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.673874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gsf9b\""
Jul 12 14:49:39.674051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.673880    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 14:49:39.683974 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.683932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:39.728426 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728770 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.728770 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.728674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2b5v\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829332 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829332 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.829581 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.829531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2b5v\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.830460 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.830410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.832527 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.832495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.832679 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.832495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.832679 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.832584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.832837 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.832763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.838115 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.838090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.839570 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.839504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2b5v\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v\") pod \"istiod-openshift-gateway-7574459656-7m5hh\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:39.984163 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:39.984112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:40.132622 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:40.132498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:40.134922 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:40.134890    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ec0c83_4ae2_4da0_bac1_7ca05e4cd6b8.slice/crio-c77076b63bfe19da5f03145bd146ad93de30591955aad0f9290bf12c18207c29 WatchSource:0}: Error finding container c77076b63bfe19da5f03145bd146ad93de30591955aad0f9290bf12c18207c29: Status 404 returned error can't find the container with id c77076b63bfe19da5f03145bd146ad93de30591955aad0f9290bf12c18207c29
Jul 12 14:49:40.462076 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:40.461991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w" event={"ID":"f1f49965-42f2-44da-8363-2bad3b549939","Type":"ContainerStarted","Data":"171282007b5447c1ee0c510d6f4b94a1f5552c43f1b427079c310cac401d8123"}
Jul 12 14:49:40.463730 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:40.463675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" event={"ID":"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8","Type":"ContainerStarted","Data":"c77076b63bfe19da5f03145bd146ad93de30591955aad0f9290bf12c18207c29"}
Jul 12 14:49:43.479935 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.479676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8" event={"ID":"ed005c91-511e-4fcb-b957-be442cbbb14a","Type":"ContainerStarted","Data":"79f813348d0578421565a49b68f06e696da35c6142f2f692e2a1a2540b92ab54"}
Jul 12 14:49:43.481370 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.481341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w" event={"ID":"f1f49965-42f2-44da-8363-2bad3b549939","Type":"ContainerStarted","Data":"28b845425848463b7cc8f44c1d5bc18832fce75687d1f9acbfbbfa25d6990fff"}
Jul 12 14:49:43.481507 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.481487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:49:43.497625 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.497575    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b855bfc69-vqmj8" podStartSLOduration=1.7196398400000001 podStartE2EDuration="5.497555611s" totalImagesPullingTime="3.777915771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:43.497269993 +0000 UTC m=+510.387414778" watchObservedRunningTime="2026-07-12 14:49:43.497555611 +0000 UTC m=+510.387700397"
Jul 12 14:49:43.518301 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.518237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w" podStartSLOduration=2.5343222819999998 podStartE2EDuration="5.518215485s" totalImagesPullingTime="2.983893203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:43.517012099 +0000 UTC m=+510.407156881" watchObservedRunningTime="2026-07-12 14:49:43.518215485 +0000 UTC m=+510.408360270"
Jul 12 14:49:43.936906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.936857    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:49:43.937055 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:43.936987    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:49:44.488200 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:44.488137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" event={"ID":"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8","Type":"ContainerStarted","Data":"1a2df1f749193c7dae6d68a82cc5591b8cf6a6cf363e1e8af6f38b66cad9d8bd"}
Jul 12 14:49:44.488682 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:44.488261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:44.511641 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:44.511589    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" podStartSLOduration=1.712289186 podStartE2EDuration="5.511572679s" totalImagesPullingTime="3.799283493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:44.509675507 +0000 UTC m=+511.399820302" watchObservedRunningTime="2026-07-12 14:49:44.511572679 +0000 UTC m=+511.401717463"
Jul 12 14:49:45.494205 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:45.494172    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:49.138028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.137994    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"]
Jul 12 14:49:49.140263 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.140248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.142304 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.142286    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t6sdk\""
Jul 12 14:49:49.142405 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.142287    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 12 14:49:49.154279 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.154246    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"]
Jul 12 14:49:49.158627 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.158597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"]
Jul 12 14:49:49.158808 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.158727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.163161 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.163106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q2p8x\""
Jul 12 14:49:49.163298 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.163269    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 12 14:49:49.176285 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.176262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"]
Jul 12 14:49:49.215745 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.215714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvnt\" (UniqueName: \"kubernetes.io/projected/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-kube-api-access-7xvnt\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.215745 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.215757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.317030 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.316996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.317215 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.317068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48xq\" (UniqueName: \"kubernetes.io/projected/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-kube-api-access-k48xq\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.317215 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.317117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvnt\" (UniqueName: \"kubernetes.io/projected/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-kube-api-access-7xvnt\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.317290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.317211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.317332 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:49.317313    2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 12 14:49:49.317410 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:49.317400    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert podName:c8ec2881-95db-4b6a-bc51-cbdd60de7d9e nodeName:}" failed. No retries permitted until 2026-07-12 14:49:49.817382737 +0000 UTC m=+516.707527500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert") pod "kserve-controller-manager-d6f4b65b8-qljsc" (UID: "c8ec2881-95db-4b6a-bc51-cbdd60de7d9e") : secret "kserve-webhook-server-cert" not found
Jul 12 14:49:49.329726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.329695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvnt\" (UniqueName: \"kubernetes.io/projected/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-kube-api-access-7xvnt\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.418079 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.418002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.418079 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.418061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48xq\" (UniqueName: \"kubernetes.io/projected/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-kube-api-access-k48xq\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.418281 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:49.418173    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 12 14:49:49.418281 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:49:49.418236    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert podName:4e40dd27-b8fe-4fd5-8435-bcf199b92bc9 nodeName:}" failed. No retries permitted until 2026-07-12 14:49:49.918220456 +0000 UTC m=+516.808365218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert") pod "llmisvc-controller-manager-777c6bd7d5-np8wj" (UID: "4e40dd27-b8fe-4fd5-8435-bcf199b92bc9") : secret "llmisvc-webhook-server-cert" not found
Jul 12 14:49:49.436028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.436003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48xq\" (UniqueName: \"kubernetes.io/projected/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-kube-api-access-k48xq\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.821438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.821397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.823788 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.823763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ec2881-95db-4b6a-bc51-cbdd60de7d9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-qljsc\" (UID: \"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:49.922390 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.922357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:49.924744 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:49.924713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e40dd27-b8fe-4fd5-8435-bcf199b92bc9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-np8wj\" (UID: \"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:50.052076 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.052030    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:50.070976 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.070927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:50.201738 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.201708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"]
Jul 12 14:49:50.202804 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:50.202769    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ec2881_95db_4b6a_bc51_cbdd60de7d9e.slice/crio-8a429f556498d21f24af9cca9b3537f9fd28ad591f7e2464a6e10e554e32c590 WatchSource:0}: Error finding container 8a429f556498d21f24af9cca9b3537f9fd28ad591f7e2464a6e10e554e32c590: Status 404 returned error can't find the container with id 8a429f556498d21f24af9cca9b3537f9fd28ad591f7e2464a6e10e554e32c590
Jul 12 14:49:50.221874 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.221848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"]
Jul 12 14:49:50.224517 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:49:50.224487    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e40dd27_b8fe_4fd5_8435_bcf199b92bc9.slice/crio-d7661cb10bc10602ddc1421844f0702f7ac7bfdd77d2dd6fdf0d9329027fcc09 WatchSource:0}: Error finding container d7661cb10bc10602ddc1421844f0702f7ac7bfdd77d2dd6fdf0d9329027fcc09: Status 404 returned error can't find the container with id d7661cb10bc10602ddc1421844f0702f7ac7bfdd77d2dd6fdf0d9329027fcc09
Jul 12 14:49:50.513695 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.513611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj" event={"ID":"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9","Type":"ContainerStarted","Data":"d7661cb10bc10602ddc1421844f0702f7ac7bfdd77d2dd6fdf0d9329027fcc09"}
Jul 12 14:49:50.514616 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:50.514595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc" event={"ID":"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e","Type":"ContainerStarted","Data":"8a429f556498d21f24af9cca9b3537f9fd28ad591f7e2464a6e10e554e32c590"}
Jul 12 14:49:52.069853 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:52.069817    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:52.070266 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:52.070014    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" podUID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" containerName="discovery" containerID="cri-o://1a2df1f749193c7dae6d68a82cc5591b8cf6a6cf363e1e8af6f38b66cad9d8bd" gracePeriod=30
Jul 12 14:49:52.526231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:52.526120    2581 generic.go:356] "Generic (PLEG): container finished" podID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" containerID="1a2df1f749193c7dae6d68a82cc5591b8cf6a6cf363e1e8af6f38b66cad9d8bd" exitCode=0
Jul 12 14:49:52.526231 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:52.526159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" event={"ID":"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8","Type":"ContainerDied","Data":"1a2df1f749193c7dae6d68a82cc5591b8cf6a6cf363e1e8af6f38b66cad9d8bd"}
Jul 12 14:49:53.005275 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.005249    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:53.150559 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2b5v\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150706    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.150940 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.150775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap\") pod \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\" (UID: \"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8\") "
Jul 12 14:49:53.151405 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.151380    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 14:49:53.153273 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts" (OuterVolumeSpecName: "cacerts") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 14:49:53.153379 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153338    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v" (OuterVolumeSpecName: "kube-api-access-n2b5v") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "kube-api-access-n2b5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:49:53.153379 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:49:53.153471 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 14:49:53.153774 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153750    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 14:49:53.153951 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.153929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs" (OuterVolumeSpecName: "local-certs") pod "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" (UID: "92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252071    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-cacerts\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252099    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2b5v\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-kube-api-access-n2b5v\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252111    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-token\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252152    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-local-certs\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252165    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-kubeconfig\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252176 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252175    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-dns-cert\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.252444 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.252183    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8-istio-csr-ca-configmap\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:49:53.532802 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.532709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj" event={"ID":"4e40dd27-b8fe-4fd5-8435-bcf199b92bc9","Type":"ContainerStarted","Data":"2e81b8698780abe352983b4f5295a191eff664bb7e39a67ed477a2e67f0830ad"}
Jul 12 14:49:53.532958 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.532806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:49:53.534191 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.534163    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"
Jul 12 14:49:53.534324 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.534167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh" event={"ID":"92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8","Type":"ContainerDied","Data":"c77076b63bfe19da5f03145bd146ad93de30591955aad0f9290bf12c18207c29"}
Jul 12 14:49:53.534391 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.534331    2581 scope.go:117] "RemoveContainer" containerID="1a2df1f749193c7dae6d68a82cc5591b8cf6a6cf363e1e8af6f38b66cad9d8bd"
Jul 12 14:49:53.536059 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.536033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc" event={"ID":"c8ec2881-95db-4b6a-bc51-cbdd60de7d9e","Type":"ContainerStarted","Data":"854afbe3dedb60beb28ccb9476d1561471fc79057e365a1da59fa3d13a765bbc"}
Jul 12 14:49:53.536228 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.536168    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:49:53.550692 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.550650    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj" podStartSLOduration=1.7654549149999998 podStartE2EDuration="4.550636606s" totalImagesPullingTime="2.785181691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:53.549803474 +0000 UTC m=+520.439948259" watchObservedRunningTime="2026-07-12 14:49:53.550636606 +0000 UTC m=+520.440781412"
Jul 12 14:49:53.568151 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.568085    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc" podStartSLOduration=1.765324696 podStartE2EDuration="4.56807243s" totalImagesPullingTime="2.802747734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:49:53.566461714 +0000 UTC m=+520.456606498" watchObservedRunningTime="2026-07-12 14:49:53.56807243 +0000 UTC m=+520.458217215"
Jul 12 14:49:53.585144 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.582044    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:53.586699 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.586668    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m5hh"]
Jul 12 14:49:53.611457 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:53.611426    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" path="/var/lib/kubelet/pods/92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8/volumes"
Jul 12 14:49:54.491156 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:49:54.491108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ksk9w"
Jul 12 14:50:24.545460 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:24.545428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-np8wj"
Jul 12 14:50:24.548654 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:24.548629    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qljsc"
Jul 12 14:50:39.173834 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.173798    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:39.174292 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.174119    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" containerName="discovery"
Jul 12 14:50:39.174292 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.174146    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" containerName="discovery"
Jul 12 14:50:39.174292 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.174243    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="92ec0c83-4ae2-4da0-bac1-7ca05e4cd6b8" containerName="discovery"
Jul 12 14:50:39.176291 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.176272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:39.178550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.178530    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 14:50:39.179062 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.179041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9h2bd\""
Jul 12 14:50:39.179183 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.179076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 14:50:39.190310 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.190278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:39.245668 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.245627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6vx\" (UniqueName: \"kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx\") pod \"kuadrant-operator-catalog-7t9kh\" (UID: \"dc8717bd-bbc9-4f6c-a003-e149692a9054\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:39.346655 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.346620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6vx\" (UniqueName: \"kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx\") pod \"kuadrant-operator-catalog-7t9kh\" (UID: \"dc8717bd-bbc9-4f6c-a003-e149692a9054\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:39.354373 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.354341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6vx\" (UniqueName: \"kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx\") pod \"kuadrant-operator-catalog-7t9kh\" (UID: \"dc8717bd-bbc9-4f6c-a003-e149692a9054\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:39.486967 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.486867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:39.531170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.531115    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:39.612824 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.612800    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:39.615390 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:50:39.615365    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8717bd_bbc9_4f6c_a003_e149692a9054.slice/crio-d4cb6722a3ffa9e47e548b69eab6f4a09206ac27fe478e5cdb81eea4fc3e48a9 WatchSource:0}: Error finding container d4cb6722a3ffa9e47e548b69eab6f4a09206ac27fe478e5cdb81eea4fc3e48a9: Status 404 returned error can't find the container with id d4cb6722a3ffa9e47e548b69eab6f4a09206ac27fe478e5cdb81eea4fc3e48a9
Jul 12 14:50:39.727104 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.727071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" event={"ID":"dc8717bd-bbc9-4f6c-a003-e149692a9054","Type":"ContainerStarted","Data":"d4cb6722a3ffa9e47e548b69eab6f4a09206ac27fe478e5cdb81eea4fc3e48a9"}
Jul 12 14:50:39.735901 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.735871    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkvtd"]
Jul 12 14:50:39.739445 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.739400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:39.745049 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.745027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkvtd"]
Jul 12 14:50:39.850944 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.850913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbx5g\" (UniqueName: \"kubernetes.io/projected/dc184baf-c25b-4619-a333-4189cef31cfd-kube-api-access-pbx5g\") pod \"kuadrant-operator-catalog-lkvtd\" (UID: \"dc184baf-c25b-4619-a333-4189cef31cfd\") " pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:39.952331 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.952285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbx5g\" (UniqueName: \"kubernetes.io/projected/dc184baf-c25b-4619-a333-4189cef31cfd-kube-api-access-pbx5g\") pod \"kuadrant-operator-catalog-lkvtd\" (UID: \"dc184baf-c25b-4619-a333-4189cef31cfd\") " pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:39.960085 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:39.960060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbx5g\" (UniqueName: \"kubernetes.io/projected/dc184baf-c25b-4619-a333-4189cef31cfd-kube-api-access-pbx5g\") pod \"kuadrant-operator-catalog-lkvtd\" (UID: \"dc184baf-c25b-4619-a333-4189cef31cfd\") " pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:40.049393 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:40.049305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:40.175358 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:40.175336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkvtd"]
Jul 12 14:50:40.177717 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:50:40.177689    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc184baf_c25b_4619_a333_4189cef31cfd.slice/crio-2686bdf8b5283be81bf8df4531ac26aa78707f3631392c195f677ed0e17f2d8a WatchSource:0}: Error finding container 2686bdf8b5283be81bf8df4531ac26aa78707f3631392c195f677ed0e17f2d8a: Status 404 returned error can't find the container with id 2686bdf8b5283be81bf8df4531ac26aa78707f3631392c195f677ed0e17f2d8a
Jul 12 14:50:40.732251 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:40.732206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd" event={"ID":"dc184baf-c25b-4619-a333-4189cef31cfd","Type":"ContainerStarted","Data":"2686bdf8b5283be81bf8df4531ac26aa78707f3631392c195f677ed0e17f2d8a"}
Jul 12 14:50:42.742925 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.742888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" event={"ID":"dc8717bd-bbc9-4f6c-a003-e149692a9054","Type":"ContainerStarted","Data":"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"}
Jul 12 14:50:42.743390 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.742982    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" podUID="dc8717bd-bbc9-4f6c-a003-e149692a9054" containerName="registry-server" containerID="cri-o://093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7" gracePeriod=2
Jul 12 14:50:42.744420 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.744386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd" event={"ID":"dc184baf-c25b-4619-a333-4189cef31cfd","Type":"ContainerStarted","Data":"3bd59632a01c72715391bd52d72a23a482244610663b7344345c53a1606f5425"}
Jul 12 14:50:42.758135 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.758077    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" podStartSLOduration=1.5181283639999998 podStartE2EDuration="3.758059821s" totalImagesPullingTime="2.239931457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:50:42.756099419 +0000 UTC m=+569.646244205" watchObservedRunningTime="2026-07-12 14:50:42.758059821 +0000 UTC m=+569.648204606"
Jul 12 14:50:42.769886 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.769843    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd" podStartSLOduration=2.091709158 podStartE2EDuration="3.769826669s" totalImagesPullingTime="1.678117511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:50:42.768419473 +0000 UTC m=+569.658564259" watchObservedRunningTime="2026-07-12 14:50:42.769826669 +0000 UTC m=+569.659971453"
Jul 12 14:50:42.983685 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:42.983661    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:43.079170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.079120    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6vx\" (UniqueName: \"kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx\") pod \"dc8717bd-bbc9-4f6c-a003-e149692a9054\" (UID: \"dc8717bd-bbc9-4f6c-a003-e149692a9054\") "
Jul 12 14:50:43.081324 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.081296    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx" (OuterVolumeSpecName: "kube-api-access-zt6vx") pod "dc8717bd-bbc9-4f6c-a003-e149692a9054" (UID: "dc8717bd-bbc9-4f6c-a003-e149692a9054"). InnerVolumeSpecName "kube-api-access-zt6vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:50:43.180056 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.180027    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt6vx\" (UniqueName: \"kubernetes.io/projected/dc8717bd-bbc9-4f6c-a003-e149692a9054-kube-api-access-zt6vx\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:50:43.749777 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.749745    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc8717bd-bbc9-4f6c-a003-e149692a9054" containerID="093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7" exitCode=0
Jul 12 14:50:43.750257 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.749793    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh"
Jul 12 14:50:43.750257 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.749827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" event={"ID":"dc8717bd-bbc9-4f6c-a003-e149692a9054","Type":"ContainerDied","Data":"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"}
Jul 12 14:50:43.750257 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.749876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9kh" event={"ID":"dc8717bd-bbc9-4f6c-a003-e149692a9054","Type":"ContainerDied","Data":"d4cb6722a3ffa9e47e548b69eab6f4a09206ac27fe478e5cdb81eea4fc3e48a9"}
Jul 12 14:50:43.750257 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.749895    2581 scope.go:117] "RemoveContainer" containerID="093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"
Jul 12 14:50:43.758606 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.758589    2581 scope.go:117] "RemoveContainer" containerID="093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"
Jul 12 14:50:43.758898 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:50:43.758879    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7\": container with ID starting with 093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7 not found: ID does not exist" containerID="093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"
Jul 12 14:50:43.758960 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.758908    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7"} err="failed to get container status \"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7\": rpc error: code = NotFound desc = could not find container \"093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7\": container with ID starting with 093103dafb6a62b99c7197c70f05142ea560b4b57b0e147af24691a20be47bf7 not found: ID does not exist"
Jul 12 14:50:43.764517 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.764490    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:43.766591 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:43.766573    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9kh"]
Jul 12 14:50:45.610660 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:45.610625    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc8717bd-bbc9-4f6c-a003-e149692a9054" path="/var/lib/kubelet/pods/dc8717bd-bbc9-4f6c-a003-e149692a9054/volumes"
Jul 12 14:50:50.050112 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:50.050077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:50.050530 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:50.050159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:50.073772 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:50.073747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:50:50.802726 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:50:50.802696    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lkvtd"
Jul 12 14:51:10.504891 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.504854    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"]
Jul 12 14:51:10.505409 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.505334    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8717bd-bbc9-4f6c-a003-e149692a9054" containerName="registry-server"
Jul 12 14:51:10.505409 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.505352    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8717bd-bbc9-4f6c-a003-e149692a9054" containerName="registry-server"
Jul 12 14:51:10.505518 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.505455    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc8717bd-bbc9-4f6c-a003-e149692a9054" containerName="registry-server"
Jul 12 14:51:10.508384 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.508364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:10.510557 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.510536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 12 14:51:10.510671 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.510636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bsgsk\""
Jul 12 14:51:10.518713 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.518690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"]
Jul 12 14:51:10.624221 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.624183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrwpt\" (UniqueName: \"kubernetes.io/projected/bee2c649-ffa1-490d-a675-b1f1fb2552be-kube-api-access-wrwpt\") pod \"dns-operator-controller-manager-864dd78c4c-8cjd5\" (UID: \"bee2c649-ffa1-490d-a675-b1f1fb2552be\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:10.725059 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.725019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrwpt\" (UniqueName: \"kubernetes.io/projected/bee2c649-ffa1-490d-a675-b1f1fb2552be-kube-api-access-wrwpt\") pod \"dns-operator-controller-manager-864dd78c4c-8cjd5\" (UID: \"bee2c649-ffa1-490d-a675-b1f1fb2552be\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:10.733274 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.733239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrwpt\" (UniqueName: \"kubernetes.io/projected/bee2c649-ffa1-490d-a675-b1f1fb2552be-kube-api-access-wrwpt\") pod \"dns-operator-controller-manager-864dd78c4c-8cjd5\" (UID: \"bee2c649-ffa1-490d-a675-b1f1fb2552be\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:10.819177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.819140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:10.963538 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:10.963514    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"]
Jul 12 14:51:10.965588 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:10.965561    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee2c649_ffa1_490d_a675_b1f1fb2552be.slice/crio-0a198af04df93e8a905d069cc52b885e391c43e51668f7cae44319e0dc1f6343 WatchSource:0}: Error finding container 0a198af04df93e8a905d069cc52b885e391c43e51668f7cae44319e0dc1f6343: Status 404 returned error can't find the container with id 0a198af04df93e8a905d069cc52b885e391c43e51668f7cae44319e0dc1f6343
Jul 12 14:51:11.877521 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:11.877486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5" event={"ID":"bee2c649-ffa1-490d-a675-b1f1fb2552be","Type":"ContainerStarted","Data":"0a198af04df93e8a905d069cc52b885e391c43e51668f7cae44319e0dc1f6343"}
Jul 12 14:51:12.883677 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:12.883641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5" event={"ID":"bee2c649-ffa1-490d-a675-b1f1fb2552be","Type":"ContainerStarted","Data":"32424f4f046e2cdaa3222b582fd4512fcab68caef809d90f88cf5e79606057b3"}
Jul 12 14:51:12.884063 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:12.883760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:12.898813 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:12.898765    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5" podStartSLOduration=1.080344959 podStartE2EDuration="2.898748708s" totalImagesPullingTime="1.818403749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:12.898372101 +0000 UTC m=+599.788516889" watchObservedRunningTime="2026-07-12 14:51:12.898748708 +0000 UTC m=+599.788893493"
Jul 12 14:51:13.520503 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.520473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:51:13.520677 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.520566    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:51:13.903635 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.903582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"]
Jul 12 14:51:13.906860 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.906844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:13.908885 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.908845    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-87gcg\""
Jul 12 14:51:13.914799 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.914775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"]
Jul 12 14:51:13.957315 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:13.957277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2dm\" (UniqueName: \"kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm\") pod \"limitador-operator-controller-manager-859d7b78bd-2szpk\" (UID: \"117e02bb-490d-4373-a0f5-9af35ca871ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:14.058473 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:14.058438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2dm\" (UniqueName: \"kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm\") pod \"limitador-operator-controller-manager-859d7b78bd-2szpk\" (UID: \"117e02bb-490d-4373-a0f5-9af35ca871ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:14.068721 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:14.068684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2dm\" (UniqueName: \"kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm\") pod \"limitador-operator-controller-manager-859d7b78bd-2szpk\" (UID: \"117e02bb-490d-4373-a0f5-9af35ca871ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:14.217549 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:14.217455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:14.352540 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:14.352510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"]
Jul 12 14:51:14.355233 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:14.355202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117e02bb_490d_4373_a0f5_9af35ca871ca.slice/crio-ea01e76a6234852f798a5c411387c4c3b3bc5946a226d8e883053d38dc7fb2fb WatchSource:0}: Error finding container ea01e76a6234852f798a5c411387c4c3b3bc5946a226d8e883053d38dc7fb2fb: Status 404 returned error can't find the container with id ea01e76a6234852f798a5c411387c4c3b3bc5946a226d8e883053d38dc7fb2fb
Jul 12 14:51:14.893935 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:14.893905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk" event={"ID":"117e02bb-490d-4373-a0f5-9af35ca871ca","Type":"ContainerStarted","Data":"ea01e76a6234852f798a5c411387c4c3b3bc5946a226d8e883053d38dc7fb2fb"}
Jul 12 14:51:16.904645 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:16.904603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk" event={"ID":"117e02bb-490d-4373-a0f5-9af35ca871ca","Type":"ContainerStarted","Data":"8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71"}
Jul 12 14:51:16.905222 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:16.904665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:16.922027 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:16.921963    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk" podStartSLOduration=2.365475953 podStartE2EDuration="3.921945604s" totalImagesPullingTime="1.556469651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:16.920790015 +0000 UTC m=+603.810934801" watchObservedRunningTime="2026-07-12 14:51:16.921945604 +0000 UTC m=+603.812090389"
Jul 12 14:51:18.841778 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.841732    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"]
Jul 12 14:51:18.845291 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.845267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:18.847318 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.847298    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bbt4m\""
Jul 12 14:51:18.858621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.858588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"]
Jul 12 14:51:18.905686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.905647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:18.905686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:18.905689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8jcz\" (UniqueName: \"kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.006746 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.006705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.006746 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.006743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8jcz\" (UniqueName: \"kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.007113 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.007091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.020755 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.020725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8jcz\" (UniqueName: \"kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.156017 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.155925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:19.286027 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.285997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"]
Jul 12 14:51:19.288823 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:19.288794    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424e0ef7_9c59_41f6_b027_2843c1e6f9ba.slice/crio-e64820d87f7f8ba41101eaf33e3bd9c77e93b6f603c6cfb33aae5608d19b7275 WatchSource:0}: Error finding container e64820d87f7f8ba41101eaf33e3bd9c77e93b6f603c6cfb33aae5608d19b7275: Status 404 returned error can't find the container with id e64820d87f7f8ba41101eaf33e3bd9c77e93b6f603c6cfb33aae5608d19b7275
Jul 12 14:51:19.291471 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.291456    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 14:51:19.920213 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:19.920171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx" event={"ID":"424e0ef7-9c59-41f6-b027-2843c1e6f9ba","Type":"ContainerStarted","Data":"e64820d87f7f8ba41101eaf33e3bd9c77e93b6f603c6cfb33aae5608d19b7275"}
Jul 12 14:51:22.122416 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.122384    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"]
Jul 12 14:51:22.125757 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.125733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:22.127718 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.127695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kv27f\""
Jul 12 14:51:22.137350 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.137326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"]
Jul 12 14:51:22.234291 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.234243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsj5m\" (UniqueName: \"kubernetes.io/projected/1aa4fce0-3582-4d7e-a1b0-5b835e296745-kube-api-access-tsj5m\") pod \"authorino-operator-75cc8d5cb7-kr2zp\" (UID: \"1aa4fce0-3582-4d7e-a1b0-5b835e296745\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:22.335397 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.335356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsj5m\" (UniqueName: \"kubernetes.io/projected/1aa4fce0-3582-4d7e-a1b0-5b835e296745-kube-api-access-tsj5m\") pod \"authorino-operator-75cc8d5cb7-kr2zp\" (UID: \"1aa4fce0-3582-4d7e-a1b0-5b835e296745\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:22.344233 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.344200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsj5m\" (UniqueName: \"kubernetes.io/projected/1aa4fce0-3582-4d7e-a1b0-5b835e296745-kube-api-access-tsj5m\") pod \"authorino-operator-75cc8d5cb7-kr2zp\" (UID: \"1aa4fce0-3582-4d7e-a1b0-5b835e296745\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:22.440243 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.440157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:22.580784 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.580760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"]
Jul 12 14:51:22.582985 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:22.582950    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa4fce0_3582_4d7e_a1b0_5b835e296745.slice/crio-850c728beff0b5c3cbf672eb2a29f85fd21b559c2187171865aafb89244d35ad WatchSource:0}: Error finding container 850c728beff0b5c3cbf672eb2a29f85fd21b559c2187171865aafb89244d35ad: Status 404 returned error can't find the container with id 850c728beff0b5c3cbf672eb2a29f85fd21b559c2187171865aafb89244d35ad
Jul 12 14:51:22.937051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:22.937018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp" event={"ID":"1aa4fce0-3582-4d7e-a1b0-5b835e296745","Type":"ContainerStarted","Data":"850c728beff0b5c3cbf672eb2a29f85fd21b559c2187171865aafb89244d35ad"}
Jul 12 14:51:23.890437 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:23.890401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cjd5"
Jul 12 14:51:25.954734 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.954684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx" event={"ID":"424e0ef7-9c59-41f6-b027-2843c1e6f9ba","Type":"ContainerStarted","Data":"b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953"}
Jul 12 14:51:25.955602 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.954770    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:25.956691 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.956662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp" event={"ID":"1aa4fce0-3582-4d7e-a1b0-5b835e296745","Type":"ContainerStarted","Data":"3b4099a16acf678be5f505d551b2f686489ba0c26a5d6131a280863804591016"}
Jul 12 14:51:25.956824 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.956811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:25.972883 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.972832    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx" podStartSLOduration=1.557402047 podStartE2EDuration="7.97281525s" totalImagesPullingTime="6.415413203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:25.970848027 +0000 UTC m=+612.860992811" watchObservedRunningTime="2026-07-12 14:51:25.97281525 +0000 UTC m=+612.862960035"
Jul 12 14:51:25.987492 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:25.987420    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp" podStartSLOduration=0.831124857 podStartE2EDuration="3.987402074s" totalImagesPullingTime="3.156277217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:25.985808652 +0000 UTC m=+612.875953430" watchObservedRunningTime="2026-07-12 14:51:25.987402074 +0000 UTC m=+612.877546862"
Jul 12 14:51:27.912100 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:27.912063    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:28.501734 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.501699    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"]
Jul 12 14:51:28.505300 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.505279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.510904 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.510881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fcgxw\""
Jul 12 14:51:28.511021 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.510908    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 14:51:28.511021 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.510966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 14:51:28.520839 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.520816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"]
Jul 12 14:51:28.596664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.596631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.596838 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.596694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.596838 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.596754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2646l\" (UniqueName: \"kubernetes.io/projected/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-kube-api-access-2646l\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.698269 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.698234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.698476 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.698302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.698476 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.698333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2646l\" (UniqueName: \"kubernetes.io/projected/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-kube-api-access-2646l\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.699068 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.699044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.700609 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.700591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.706913 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.706882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2646l\" (UniqueName: \"kubernetes.io/projected/77f2eaac-7d18-4492-9eb3-3af47bedf6d9-kube-api-access-2646l\") pod \"kuadrant-console-plugin-66b5774985-n5nkl\" (UID: \"77f2eaac-7d18-4492-9eb3-3af47bedf6d9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.814177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.814122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"
Jul 12 14:51:28.946679 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.946652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl"]
Jul 12 14:51:28.949467 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:28.949434    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77f2eaac_7d18_4492_9eb3_3af47bedf6d9.slice/crio-d44e9e4f865dc41a0cc4d036b4afcd1ceedf563eed6ff6c1b33c14a64adcfa25 WatchSource:0}: Error finding container d44e9e4f865dc41a0cc4d036b4afcd1ceedf563eed6ff6c1b33c14a64adcfa25: Status 404 returned error can't find the container with id d44e9e4f865dc41a0cc4d036b4afcd1ceedf563eed6ff6c1b33c14a64adcfa25
Jul 12 14:51:28.971606 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:28.971574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl" event={"ID":"77f2eaac-7d18-4492-9eb3-3af47bedf6d9","Type":"ContainerStarted","Data":"d44e9e4f865dc41a0cc4d036b4afcd1ceedf563eed6ff6c1b33c14a64adcfa25"}
Jul 12 14:51:36.964310 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:36.964238    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kr2zp"
Jul 12 14:51:36.964782 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:36.964373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:38.905402 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.905344    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"]
Jul 12 14:51:38.906236 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.905580    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" containerName="manager" containerID="cri-o://b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953" gracePeriod=2
Jul 12 14:51:38.916613 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.916543    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"]
Jul 12 14:51:38.922785 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.922737    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:38.929093 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.929055    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:38.929661 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.929563    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" containerName="manager"
Jul 12 14:51:38.929661 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.929586    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" containerName="manager"
Jul 12 14:51:38.929828 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.929675    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" containerName="manager"
Jul 12 14:51:38.938049 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.937996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"]
Jul 12 14:51:38.938208 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.938108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:38.938525 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.938475    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" containerName="manager" containerID="cri-o://8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71" gracePeriod=2
Jul 12 14:51:38.940718 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.940636    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:38.950621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.950586    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"]
Jul 12 14:51:38.953070 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.953027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:38.965724 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.965432    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"]
Jul 12 14:51:38.966019 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.965980    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" containerName="manager"
Jul 12 14:51:38.966019 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.965999    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" containerName="manager"
Jul 12 14:51:38.966453 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.966109    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" containerName="manager"
Jul 12 14:51:38.967245 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.967213    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:38.968992 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.968961    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:38.969656 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.969635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:38.971566 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.971522    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:38.977411 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.977378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"]
Jul 12 14:51:38.993767 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:38.993726    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:38.997496 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.997462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ncj5\" (UniqueName: \"kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:38.997648 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.997566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:38.997648 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:38.997604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjk4\" (UniqueName: \"kubernetes.io/projected/d08d7a6e-1cb7-4767-bf60-250972f63415-kube-api-access-psjk4\") pod \"limitador-operator-controller-manager-859d7b78bd-vlddj\" (UID: \"d08d7a6e-1cb7-4767-bf60-250972f63415\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:39.098565 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.098530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ncj5\" (UniqueName: \"kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:39.098734 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.098605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:39.098734 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.098649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjk4\" (UniqueName: \"kubernetes.io/projected/d08d7a6e-1cb7-4767-bf60-250972f63415-kube-api-access-psjk4\") pod \"limitador-operator-controller-manager-859d7b78bd-vlddj\" (UID: \"d08d7a6e-1cb7-4767-bf60-250972f63415\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:39.099048 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.099022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:39.110280 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.110232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjk4\" (UniqueName: \"kubernetes.io/projected/d08d7a6e-1cb7-4767-bf60-250972f63415-kube-api-access-psjk4\") pod \"limitador-operator-controller-manager-859d7b78bd-vlddj\" (UID: \"d08d7a6e-1cb7-4767-bf60-250972f63415\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:39.110441 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.110278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ncj5\" (UniqueName: \"kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjdld\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:39.329003 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.328970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:39.336144 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:39.336105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:50.807032 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.807001    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:50.809273 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:50.809237    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:50.810765 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.810742    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:50.812585 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:50.812543    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:50.814063 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:50.814029    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:50.817427 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.817403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"]
Jul 12 14:51:50.819401 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:50.819373    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08d7a6e_1cb7_4767_bf60_250972f63415.slice/crio-15ca2dfe781f2de707e8aec01fef33ebec98bd722f61252c2cda79f48ed0cfc2 WatchSource:0}: Error finding container 15ca2dfe781f2de707e8aec01fef33ebec98bd722f61252c2cda79f48ed0cfc2: Status 404 returned error can't find the container with id 15ca2dfe781f2de707e8aec01fef33ebec98bd722f61252c2cda79f48ed0cfc2
Jul 12 14:51:50.846827 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.846806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:50.849253 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:51:50.849220    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025b4500_71c0_42e1_a8c1_a7f88ff8e6c1.slice/crio-87e79fe0e405d45d344d4f7d7dfe6ee3978bb8431f251a0dc57888af6eb5e90e WatchSource:0}: Error finding container 87e79fe0e405d45d344d4f7d7dfe6ee3978bb8431f251a0dc57888af6eb5e90e: Status 404 returned error can't find the container with id 87e79fe0e405d45d344d4f7d7dfe6ee3978bb8431f251a0dc57888af6eb5e90e
Jul 12 14:51:50.907337 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.907312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8jcz\" (UniqueName: \"kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz\") pod \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") "
Jul 12 14:51:50.907443 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.907364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume\") pod \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\" (UID: \"424e0ef7-9c59-41f6-b027-2843c1e6f9ba\") "
Jul 12 14:51:50.907443 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.907396    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw2dm\" (UniqueName: \"kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm\") pod \"117e02bb-490d-4373-a0f5-9af35ca871ca\" (UID: \"117e02bb-490d-4373-a0f5-9af35ca871ca\") "
Jul 12 14:51:50.907865 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.907841    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "424e0ef7-9c59-41f6-b027-2843c1e6f9ba" (UID: "424e0ef7-9c59-41f6-b027-2843c1e6f9ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 14:51:50.909429 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.909406    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz" (OuterVolumeSpecName: "kube-api-access-r8jcz") pod "424e0ef7-9c59-41f6-b027-2843c1e6f9ba" (UID: "424e0ef7-9c59-41f6-b027-2843c1e6f9ba"). InnerVolumeSpecName "kube-api-access-r8jcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:51:50.909501 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:50.909430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm" (OuterVolumeSpecName: "kube-api-access-vw2dm") pod "117e02bb-490d-4373-a0f5-9af35ca871ca" (UID: "117e02bb-490d-4373-a0f5-9af35ca871ca"). InnerVolumeSpecName "kube-api-access-vw2dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:51:51.008763 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.008725    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8jcz\" (UniqueName: \"kubernetes.io/projected/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-kube-api-access-r8jcz\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:51:51.008763 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.008756    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/424e0ef7-9c59-41f6-b027-2843c1e6f9ba-extensions-socket-volume\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:51:51.008763 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.008767    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw2dm\" (UniqueName: \"kubernetes.io/projected/117e02bb-490d-4373-a0f5-9af35ca871ca-kube-api-access-vw2dm\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:51:51.107676 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.107639    2581 generic.go:356] "Generic (PLEG): container finished" podID="117e02bb-490d-4373-a0f5-9af35ca871ca" containerID="8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71" exitCode=0
Jul 12 14:51:51.107843 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.107685    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:51.107843 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.107740    2581 scope.go:117] "RemoveContainer" containerID="8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71"
Jul 12 14:51:51.109286 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.109261    2581 generic.go:356] "Generic (PLEG): container finished" podID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" containerID="b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953" exitCode=0
Jul 12 14:51:51.109415 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.109324    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:51.109870 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.109824    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:51.111137 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.111104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl" event={"ID":"77f2eaac-7d18-4492-9eb3-3af47bedf6d9","Type":"ContainerStarted","Data":"bad1920a2392971037b09f97080faef238a8d2e726c629c5540ba94504a8f391"}
Jul 12 14:51:51.111407 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.111374    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:51.112964 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.112931    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:51.113073 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.113031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" event={"ID":"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1","Type":"ContainerStarted","Data":"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"}
Jul 12 14:51:51.113159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.113089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" event={"ID":"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1","Type":"ContainerStarted","Data":"87e79fe0e405d45d344d4f7d7dfe6ee3978bb8431f251a0dc57888af6eb5e90e"}
Jul 12 14:51:51.113159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.113121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:51.114771 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.114749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj" event={"ID":"d08d7a6e-1cb7-4767-bf60-250972f63415","Type":"ContainerStarted","Data":"5cfbfd48450f2b8b2de6b0b4e7c2d74d04234fe280a8c70fac5adc124b834d3a"}
Jul 12 14:51:51.114899 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.114798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:51:51.114899 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.114824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj" event={"ID":"d08d7a6e-1cb7-4767-bf60-250972f63415","Type":"ContainerStarted","Data":"15ca2dfe781f2de707e8aec01fef33ebec98bd722f61252c2cda79f48ed0cfc2"}
Jul 12 14:51:51.119008 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.118988    2581 scope.go:117] "RemoveContainer" containerID="8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71"
Jul 12 14:51:51.119364 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.119339    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71\": container with ID starting with 8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71 not found: ID does not exist" containerID="8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71"
Jul 12 14:51:51.119449 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.119375    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71"} err="failed to get container status \"8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71\": rpc error: code = NotFound desc = could not find container \"8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71\": container with ID starting with 8074461c7e1cbf17a57bf37f9887fe4b9ab5e43aa2611989bd0b173f6b80da71 not found: ID does not exist"
Jul 12 14:51:51.119449 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.119391    2581 scope.go:117] "RemoveContainer" containerID="b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953"
Jul 12 14:51:51.127289 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.127262    2581 scope.go:117] "RemoveContainer" containerID="b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953"
Jul 12 14:51:51.128120 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.128012    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953\": container with ID starting with b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953 not found: ID does not exist" containerID="b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953"
Jul 12 14:51:51.128120 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.128046    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953"} err="failed to get container status \"b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953\": rpc error: code = NotFound desc = could not find container \"b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953\": container with ID starting with b9558924a5004a54624e275bc6f68381ce41ac9019e86d6eb6054cb6ed356953 not found: ID does not exist"
Jul 12 14:51:51.129153 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.129088    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nkl" podStartSLOduration=1.381216489 podStartE2EDuration="23.129071703s" totalImagesPullingTime="21.747855214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:51.127636818 +0000 UTC m=+638.017781605" watchObservedRunningTime="2026-07-12 14:51:51.129071703 +0000 UTC m=+638.019216489"
Jul 12 14:51:51.129309 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.129283    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:51.130801 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.130779    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2szpk\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2szpk"
Jul 12 14:51:51.154144 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.153252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" podStartSLOduration=13.153232055 podStartE2EDuration="13.153232055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:51.152663675 +0000 UTC m=+638.042808472" watchObservedRunningTime="2026-07-12 14:51:51.153232055 +0000 UTC m=+638.043376842"
Jul 12 14:51:51.154351 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:51.154116    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gx8xx\" is forbidden: User \"system:node:ip-10-0-139-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-143.ec2.internal' and this object" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gx8xx"
Jul 12 14:51:51.174070 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.174009    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj" podStartSLOduration=13.173992952 podStartE2EDuration="13.173992952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:51:51.172400721 +0000 UTC m=+638.062545530" watchObservedRunningTime="2026-07-12 14:51:51.173992952 +0000 UTC m=+638.064137750"
Jul 12 14:51:51.612193 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.612159    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="117e02bb-490d-4373-a0f5-9af35ca871ca" path="/var/lib/kubelet/pods/117e02bb-490d-4373-a0f5-9af35ca871ca/volumes"
Jul 12 14:51:51.612523 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:51.612510    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424e0ef7-9c59-41f6-b027-2843c1e6f9ba" path="/var/lib/kubelet/pods/424e0ef7-9c59-41f6-b027-2843c1e6f9ba/volumes"
Jul 12 14:51:55.541166 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.541120    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:55.541626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.541322    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" podUID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" containerName="manager" containerID="cri-o://2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa" gracePeriod=10
Jul 12 14:51:55.543253 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.543232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:55.792949 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.792882    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:55.853717 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.853683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ncj5\" (UniqueName: \"kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5\") pod \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") "
Jul 12 14:51:55.853991 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.853811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume\") pod \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\" (UID: \"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1\") "
Jul 12 14:51:55.854253 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.854212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" (UID: "025b4500-71c0-42e1-a8c1-a7f88ff8e6c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 14:51:55.855925 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.855900    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5" (OuterVolumeSpecName: "kube-api-access-8ncj5") pod "025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" (UID: "025b4500-71c0-42e1-a8c1-a7f88ff8e6c1"). InnerVolumeSpecName "kube-api-access-8ncj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:51:55.954711 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.954668    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-extensions-socket-volume\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:51:55.954711 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:55.954702    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ncj5\" (UniqueName: \"kubernetes.io/projected/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1-kube-api-access-8ncj5\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:51:56.143174 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.143140    2581 generic.go:356] "Generic (PLEG): container finished" podID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" containerID="2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa" exitCode=0
Jul 12 14:51:56.143349 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.143198    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"
Jul 12 14:51:56.143349 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.143218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" event={"ID":"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1","Type":"ContainerDied","Data":"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"}
Jul 12 14:51:56.143349 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.143272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld" event={"ID":"025b4500-71c0-42e1-a8c1-a7f88ff8e6c1","Type":"ContainerDied","Data":"87e79fe0e405d45d344d4f7d7dfe6ee3978bb8431f251a0dc57888af6eb5e90e"}
Jul 12 14:51:56.143349 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.143293    2581 scope.go:117] "RemoveContainer" containerID="2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"
Jul 12 14:51:56.152105 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.152088    2581 scope.go:117] "RemoveContainer" containerID="2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"
Jul 12 14:51:56.152432 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:51:56.152415    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa\": container with ID starting with 2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa not found: ID does not exist" containerID="2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"
Jul 12 14:51:56.152485 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.152444    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa"} err="failed to get container status \"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa\": rpc error: code = NotFound desc = could not find container \"2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa\": container with ID starting with 2a07f2f0665c437077265736bf5efda4586272504525b33975350963ea2ec2aa not found: ID does not exist"
Jul 12 14:51:56.166348 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.166318    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:56.170379 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:56.170357    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjdld"]
Jul 12 14:51:57.611853 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:51:57.611817    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" path="/var/lib/kubelet/pods/025b4500-71c0-42e1-a8c1-a7f88ff8e6c1/volumes"
Jul 12 14:52:02.124832 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:02.124805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlddj"
Jul 12 14:52:11.876651 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.876616    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"]
Jul 12 14:52:11.877187 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.877169    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" containerName="manager"
Jul 12 14:52:11.877239 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.877190    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" containerName="manager"
Jul 12 14:52:11.877306 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.877295    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="025b4500-71c0-42e1-a8c1-a7f88ff8e6c1" containerName="manager"
Jul 12 14:52:11.883374 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.883339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.885644 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.885620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 14:52:11.885770 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.885681    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mfv29\""
Jul 12 14:52:11.891400 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.891373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"]
Jul 12 14:52:11.996686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996698    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.996905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.997064 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd94a84-e5f7-4ebd-8882-8750beeca880-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:11.997064 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:11.996994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwk6\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-kube-api-access-qhwk6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098266 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098438 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098724 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098797 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098850 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd94a84-e5f7-4ebd-8882-8750beeca880-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.098906 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwk6\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-kube-api-access-qhwk6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.099016 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.098908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.099107 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.099084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.099433 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.099414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd94a84-e5f7-4ebd-8882-8750beeca880-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.100717 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.100693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.100813 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.100797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.109153 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.109116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwk6\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-kube-api-access-qhwk6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.109372 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.109352    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd94a84-e5f7-4ebd-8882-8750beeca880-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwcdd\" (UID: \"cdd94a84-e5f7-4ebd-8882-8750beeca880\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.195170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.195051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:12.353261 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:12.353236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"]
Jul 12 14:52:12.355242 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:52:12.355205    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd94a84_e5f7_4ebd_8882_8750beeca880.slice/crio-933a725b5482649ab982ec6d67ded1fb09902d09c33cd2aebcecfee9b59d5c6c WatchSource:0}: Error finding container 933a725b5482649ab982ec6d67ded1fb09902d09c33cd2aebcecfee9b59d5c6c: Status 404 returned error can't find the container with id 933a725b5482649ab982ec6d67ded1fb09902d09c33cd2aebcecfee9b59d5c6c
Jul 12 14:52:13.232234 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:13.232191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" event={"ID":"cdd94a84-e5f7-4ebd-8882-8750beeca880","Type":"ContainerStarted","Data":"933a725b5482649ab982ec6d67ded1fb09902d09c33cd2aebcecfee9b59d5c6c"}
Jul 12 14:52:15.387490 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:15.387444    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:52:15.387775 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:15.387531    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:52:15.387775 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:15.387561    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:52:16.250226 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:16.250193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" event={"ID":"cdd94a84-e5f7-4ebd-8882-8750beeca880","Type":"ContainerStarted","Data":"ea8699a4b9bc15ab39b1695bf6f59298aba760584754ff10883d6e9468da784c"}
Jul 12 14:52:16.287300 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:16.287237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" podStartSLOduration=2.257235536 podStartE2EDuration="5.287219302s" totalImagesPullingTime="3.029983766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:52:16.284625461 +0000 UTC m=+663.174770245" watchObservedRunningTime="2026-07-12 14:52:16.287219302 +0000 UTC m=+663.177364065"
Jul 12 14:52:17.195858 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:17.195818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:17.200869 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:17.200843    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:17.256448 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:17.256417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:17.257526 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:17.257500    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:52:27.947320 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:27.947291    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:27.952690 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:27.952668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:27.955318 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:27.955290    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 14:52:27.957225 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:27.957200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:28.037709 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.037671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhxh\" (UniqueName: \"kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.037905 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.037733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.045939 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.045910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:28.138432 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.138402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhxh\" (UniqueName: \"kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.138635 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.138450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.139195 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.139174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.146814 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.146770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhxh\" (UniqueName: \"kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh\") pod \"limitador-limitador-64c94fd64f-b5jf5\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.263821 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.263726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:28.399670 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.399633    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:28.401868 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:52:28.401841    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ad6f91_895c_4fd7_a267_f1612fa8812f.slice/crio-0254f5f0a233c92f3ca6c5157ddad1e58520d7ef1959289c65e16534a1959046 WatchSource:0}: Error finding container 0254f5f0a233c92f3ca6c5157ddad1e58520d7ef1959289c65e16534a1959046: Status 404 returned error can't find the container with id 0254f5f0a233c92f3ca6c5157ddad1e58520d7ef1959289c65e16534a1959046
Jul 12 14:52:28.407134 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.407100    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:52:28.410422 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.410391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.417663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.417634    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:52:28.440145 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.440010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6tt\" (UniqueName: \"kubernetes.io/projected/34def8ad-c591-4c79-bd13-3db72cc48bc6-kube-api-access-hl6tt\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.440145 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.440111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34def8ad-c591-4c79-bd13-3db72cc48bc6-config-file\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.441678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.441656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:52:28.541056 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.540957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34def8ad-c591-4c79-bd13-3db72cc48bc6-config-file\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.541056 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.541049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6tt\" (UniqueName: \"kubernetes.io/projected/34def8ad-c591-4c79-bd13-3db72cc48bc6-kube-api-access-hl6tt\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.541631 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.541610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34def8ad-c591-4c79-bd13-3db72cc48bc6-config-file\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.549104 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.549067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6tt\" (UniqueName: \"kubernetes.io/projected/34def8ad-c591-4c79-bd13-3db72cc48bc6-kube-api-access-hl6tt\") pod \"limitador-limitador-54d6d988d5-n8thk\" (UID: \"34def8ad-c591-4c79-bd13-3db72cc48bc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.723308 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.723268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:28.884551 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:28.884521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:52:28.886884 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:52:28.886849    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34def8ad_c591_4c79_bd13_3db72cc48bc6.slice/crio-e6f41cd6fc3da515561e646e8679bb27c421f2ffe26c4007a3d7f944bce2580d WatchSource:0}: Error finding container e6f41cd6fc3da515561e646e8679bb27c421f2ffe26c4007a3d7f944bce2580d: Status 404 returned error can't find the container with id e6f41cd6fc3da515561e646e8679bb27c421f2ffe26c4007a3d7f944bce2580d
Jul 12 14:52:29.321978 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:29.321889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" event={"ID":"57ad6f91-895c-4fd7-a267-f1612fa8812f","Type":"ContainerStarted","Data":"0254f5f0a233c92f3ca6c5157ddad1e58520d7ef1959289c65e16534a1959046"}
Jul 12 14:52:29.325360 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:29.325226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk" event={"ID":"34def8ad-c591-4c79-bd13-3db72cc48bc6","Type":"ContainerStarted","Data":"e6f41cd6fc3da515561e646e8679bb27c421f2ffe26c4007a3d7f944bce2580d"}
Jul 12 14:52:32.343874 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.343838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" event={"ID":"57ad6f91-895c-4fd7-a267-f1612fa8812f","Type":"ContainerStarted","Data":"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"}
Jul 12 14:52:32.344333 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.343905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:32.345404 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.345371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk" event={"ID":"34def8ad-c591-4c79-bd13-3db72cc48bc6","Type":"ContainerStarted","Data":"a4d80ca7798bf4d0abc12cbc4b020fa7b08946113b2afdaecffe5c0abbd42ef2"}
Jul 12 14:52:32.345522 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.345430    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:32.359694 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.359633    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" podStartSLOduration=2.342675244 podStartE2EDuration="5.359613848s" totalImagesPullingTime="3.016938604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:52:32.359588104 +0000 UTC m=+679.249732891" watchObservedRunningTime="2026-07-12 14:52:32.359613848 +0000 UTC m=+679.249758635"
Jul 12 14:52:32.374387 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:32.374325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk" podStartSLOduration=1.834800963 podStartE2EDuration="4.374301714s" totalImagesPullingTime="2.539500751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:52:32.374149826 +0000 UTC m=+679.264294608" watchObservedRunningTime="2026-07-12 14:52:32.374301714 +0000 UTC m=+679.264446501"
Jul 12 14:52:43.351104 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:43.351070    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:43.351550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:43.351174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n8thk"
Jul 12 14:52:43.409159 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:43.409109    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:43.409356 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:43.409316    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" podUID="57ad6f91-895c-4fd7-a267-f1612fa8812f" containerName="limitador" containerID="cri-o://27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce" gracePeriod=30
Jul 12 14:52:43.964022 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:43.963991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:44.085535 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.085504    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfhxh\" (UniqueName: \"kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh\") pod \"57ad6f91-895c-4fd7-a267-f1612fa8812f\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") "
Jul 12 14:52:44.085709 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.085559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file\") pod \"57ad6f91-895c-4fd7-a267-f1612fa8812f\" (UID: \"57ad6f91-895c-4fd7-a267-f1612fa8812f\") "
Jul 12 14:52:44.085974 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.085947    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file" (OuterVolumeSpecName: "config-file") pod "57ad6f91-895c-4fd7-a267-f1612fa8812f" (UID: "57ad6f91-895c-4fd7-a267-f1612fa8812f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 14:52:44.087728 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.087702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh" (OuterVolumeSpecName: "kube-api-access-sfhxh") pod "57ad6f91-895c-4fd7-a267-f1612fa8812f" (UID: "57ad6f91-895c-4fd7-a267-f1612fa8812f"). InnerVolumeSpecName "kube-api-access-sfhxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:52:44.186680 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.186646    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ad6f91-895c-4fd7-a267-f1612fa8812f-config-file\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:52:44.186680 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.186675    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfhxh\" (UniqueName: \"kubernetes.io/projected/57ad6f91-895c-4fd7-a267-f1612fa8812f-kube-api-access-sfhxh\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:52:44.401337 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.401249    2581 generic.go:356] "Generic (PLEG): container finished" podID="57ad6f91-895c-4fd7-a267-f1612fa8812f" containerID="27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce" exitCode=0
Jul 12 14:52:44.401337 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.401291    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"
Jul 12 14:52:44.401337 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.401321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" event={"ID":"57ad6f91-895c-4fd7-a267-f1612fa8812f","Type":"ContainerDied","Data":"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"}
Jul 12 14:52:44.401818 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.401364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5jf5" event={"ID":"57ad6f91-895c-4fd7-a267-f1612fa8812f","Type":"ContainerDied","Data":"0254f5f0a233c92f3ca6c5157ddad1e58520d7ef1959289c65e16534a1959046"}
Jul 12 14:52:44.401818 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.401385    2581 scope.go:117] "RemoveContainer" containerID="27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"
Jul 12 14:52:44.410642 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.410505    2581 scope.go:117] "RemoveContainer" containerID="27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"
Jul 12 14:52:44.410856 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:52:44.410838    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce\": container with ID starting with 27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce not found: ID does not exist" containerID="27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"
Jul 12 14:52:44.410920 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.410872    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce"} err="failed to get container status \"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce\": rpc error: code = NotFound desc = could not find container \"27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce\": container with ID starting with 27a2cf003960da054d6ef4d22089df04f1e0bcaf70d07afc768a244f175452ce not found: ID does not exist"
Jul 12 14:52:44.422341 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.422311    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:44.425751 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:44.425727    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5jf5"]
Jul 12 14:52:45.611013 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:52:45.610974    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ad6f91-895c-4fd7-a267-f1612fa8812f" path="/var/lib/kubelet/pods/57ad6f91-895c-4fd7-a267-f1612fa8812f/volumes"
Jul 12 14:53:07.812871 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.812780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:07.813448 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.813357    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ad6f91-895c-4fd7-a267-f1612fa8812f" containerName="limitador"
Jul 12 14:53:07.813448 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.813378    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ad6f91-895c-4fd7-a267-f1612fa8812f" containerName="limitador"
Jul 12 14:53:07.813557 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.813469    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ad6f91-895c-4fd7-a267-f1612fa8812f" containerName="limitador"
Jul 12 14:53:07.816397 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.816376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:07.818609 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.818591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 14:53:07.818711 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.818633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5j98t\""
Jul 12 14:53:07.818877 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.818865    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 14:53:07.827607 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.827577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:07.896538 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.896500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2mz\" (UniqueName: \"kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:07.896723 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.896631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:07.994856 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.994819    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:53:07.997145 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.997103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:07.997269 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.997186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2mz\" (UniqueName: \"kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:07.997312 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:53:07.997270    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 12 14:53:07.997374 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:53:07.997362    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert podName:0cbc803d-6b61-471c-a8e8-a046d701c49f nodeName:}" failed. No retries permitted until 2026-07-12 14:53:08.497314915 +0000 UTC m=+715.387459683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert") pod "maas-controller-5977755476-rj5zl" (UID: "0cbc803d-6b61-471c-a8e8-a046d701c49f") : secret "maas-controller-webhook-cert" not found
Jul 12 14:53:07.998106 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:07.998091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.005683 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.005655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2mz\" (UniqueName: \"kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:08.007583 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.007556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:53:08.098504 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.098410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.098504 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.098457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppm5m\" (UniqueName: \"kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.199558 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.199522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.199558 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.199563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppm5m\" (UniqueName: \"kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.202051 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.202028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.208328 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.208304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppm5m\" (UniqueName: \"kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m\") pod \"maas-controller-5fd9449f55-k7jlt\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") " pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.318819 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.318768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:08.451400 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.451374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:53:08.454010 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:08.453978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04038d4_5a29_4d96_84fe_41643213ff99.slice/crio-341bea542ef4a54511b98df8fc0b72e095794b357a2fe4b067621633619f626f WatchSource:0}: Error finding container 341bea542ef4a54511b98df8fc0b72e095794b357a2fe4b067621633619f626f: Status 404 returned error can't find the container with id 341bea542ef4a54511b98df8fc0b72e095794b357a2fe4b067621633619f626f
Jul 12 14:53:08.502358 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.502325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:08.504703 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.504685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") pod \"maas-controller-5977755476-rj5zl\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") " pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:08.517738 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.517708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" event={"ID":"f04038d4-5a29-4d96-84fe-41643213ff99","Type":"ContainerStarted","Data":"341bea542ef4a54511b98df8fc0b72e095794b357a2fe4b067621633619f626f"}
Jul 12 14:53:08.727199 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.727101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:08.860213 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:08.860158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:08.862786 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:08.862762    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbc803d_6b61_471c_a8e8_a046d701c49f.slice/crio-456d5d98c6d13ff8837702a65f92fae7be6445b3fc01823e1d18969869b47d95 WatchSource:0}: Error finding container 456d5d98c6d13ff8837702a65f92fae7be6445b3fc01823e1d18969869b47d95: Status 404 returned error can't find the container with id 456d5d98c6d13ff8837702a65f92fae7be6445b3fc01823e1d18969869b47d95
Jul 12 14:53:09.527122 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:09.527025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5977755476-rj5zl" event={"ID":"0cbc803d-6b61-471c-a8e8-a046d701c49f","Type":"ContainerStarted","Data":"456d5d98c6d13ff8837702a65f92fae7be6445b3fc01823e1d18969869b47d95"}
Jul 12 14:53:11.538028 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.537979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" event={"ID":"f04038d4-5a29-4d96-84fe-41643213ff99","Type":"ContainerStarted","Data":"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"}
Jul 12 14:53:11.538509 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.538168    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:11.539451 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.539423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5977755476-rj5zl" event={"ID":"0cbc803d-6b61-471c-a8e8-a046d701c49f","Type":"ContainerStarted","Data":"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"}
Jul 12 14:53:11.539567 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.539552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:11.556429 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.556375    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" podStartSLOduration=2.377861111 podStartE2EDuration="4.556359863s" totalImagesPullingTime="2.178498752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:53:11.554918963 +0000 UTC m=+718.445063750" watchObservedRunningTime="2026-07-12 14:53:11.556359863 +0000 UTC m=+718.446504649"
Jul 12 14:53:11.572179 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:11.572106    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5977755476-rj5zl" podStartSLOduration=2.791435741 podStartE2EDuration="4.572087787s" totalImagesPullingTime="1.780652046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:53:11.570873574 +0000 UTC m=+718.461018371" watchObservedRunningTime="2026-07-12 14:53:11.572087787 +0000 UTC m=+718.462232573"
Jul 12 14:53:22.551501 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.551472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:22.551907 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.551640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:53:22.605501 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.605469    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:22.605769 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.605740    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5977755476-rj5zl" podUID="0cbc803d-6b61-471c-a8e8-a046d701c49f" containerName="manager" containerID="cri-o://08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57" gracePeriod=30
Jul 12 14:53:22.860520 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.860495    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:22.944610 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.944573    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z2mz\" (UniqueName: \"kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz\") pod \"0cbc803d-6b61-471c-a8e8-a046d701c49f\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") "
Jul 12 14:53:22.944610 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.944626    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") pod \"0cbc803d-6b61-471c-a8e8-a046d701c49f\" (UID: \"0cbc803d-6b61-471c-a8e8-a046d701c49f\") "
Jul 12 14:53:22.946941 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.946898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz" (OuterVolumeSpecName: "kube-api-access-9z2mz") pod "0cbc803d-6b61-471c-a8e8-a046d701c49f" (UID: "0cbc803d-6b61-471c-a8e8-a046d701c49f"). InnerVolumeSpecName "kube-api-access-9z2mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:53:22.947086 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:22.946975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0cbc803d-6b61-471c-a8e8-a046d701c49f" (UID: "0cbc803d-6b61-471c-a8e8-a046d701c49f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 14:53:23.045524 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.045488    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z2mz\" (UniqueName: \"kubernetes.io/projected/0cbc803d-6b61-471c-a8e8-a046d701c49f-kube-api-access-9z2mz\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:53:23.045524 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.045519    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cbc803d-6b61-471c-a8e8-a046d701c49f-webhook-cert\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:53:23.599769 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.599726    2581 generic.go:356] "Generic (PLEG): container finished" podID="0cbc803d-6b61-471c-a8e8-a046d701c49f" containerID="08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57" exitCode=0
Jul 12 14:53:23.600185 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.599776    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5977755476-rj5zl"
Jul 12 14:53:23.600185 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.599814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5977755476-rj5zl" event={"ID":"0cbc803d-6b61-471c-a8e8-a046d701c49f","Type":"ContainerDied","Data":"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"}
Jul 12 14:53:23.600185 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.599871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5977755476-rj5zl" event={"ID":"0cbc803d-6b61-471c-a8e8-a046d701c49f","Type":"ContainerDied","Data":"456d5d98c6d13ff8837702a65f92fae7be6445b3fc01823e1d18969869b47d95"}
Jul 12 14:53:23.600185 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.599896    2581 scope.go:117] "RemoveContainer" containerID="08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"
Jul 12 14:53:23.609895 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.609719    2581 scope.go:117] "RemoveContainer" containerID="08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"
Jul 12 14:53:23.610006 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:53:23.609986    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57\": container with ID starting with 08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57 not found: ID does not exist" containerID="08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"
Jul 12 14:53:23.610063 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.610019    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57"} err="failed to get container status \"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57\": rpc error: code = NotFound desc = could not find container \"08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57\": container with ID starting with 08a371db5aefa4309d65c2dec37a6d7cf9cfa7c39dbc555b9a7b3358e9c8ad57 not found: ID does not exist"
Jul 12 14:53:23.621114 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.621085    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:23.626922 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:23.626898    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5977755476-rj5zl"]
Jul 12 14:53:25.611969 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:25.611931    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cbc803d-6b61-471c-a8e8-a046d701c49f" path="/var/lib/kubelet/pods/0cbc803d-6b61-471c-a8e8-a046d701c49f/volumes"
Jul 12 14:53:43.803700 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.803665    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"]
Jul 12 14:53:43.804188 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.804119    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cbc803d-6b61-471c-a8e8-a046d701c49f" containerName="manager"
Jul 12 14:53:43.804188 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.804149    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cbc803d-6b61-471c-a8e8-a046d701c49f" containerName="manager"
Jul 12 14:53:43.804261 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.804233    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cbc803d-6b61-471c-a8e8-a046d701c49f" containerName="manager"
Jul 12 14:53:43.809957 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.809942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:43.812406 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.812385    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 12 14:53:43.812530 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.812407    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 14:53:43.812530 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.812436    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 14:53:43.813003 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.812990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t5b6m\""
Jul 12 14:53:43.818181 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.817770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"]
Jul 12 14:53:43.932238 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.932203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2924de04-a89c-4019-a917-fb1517105db5-openshift-service-ca\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:43.932416 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.932266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl4sg\" (UniqueName: \"kubernetes.io/projected/2924de04-a89c-4019-a917-fb1517105db5-kube-api-access-kl4sg\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:43.932416 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:43.932289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2924de04-a89c-4019-a917-fb1517105db5-maas-api-tls\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.033620 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.033587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl4sg\" (UniqueName: \"kubernetes.io/projected/2924de04-a89c-4019-a917-fb1517105db5-kube-api-access-kl4sg\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.033620 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.033620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2924de04-a89c-4019-a917-fb1517105db5-maas-api-tls\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.033863 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.033671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2924de04-a89c-4019-a917-fb1517105db5-openshift-service-ca\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.034292 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.034274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2924de04-a89c-4019-a917-fb1517105db5-openshift-service-ca\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.036193 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.036171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2924de04-a89c-4019-a917-fb1517105db5-maas-api-tls\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.041004 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.040984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl4sg\" (UniqueName: \"kubernetes.io/projected/2924de04-a89c-4019-a917-fb1517105db5-kube-api-access-kl4sg\") pod \"maas-api-84b6b4b759-glhmj\" (UID: \"2924de04-a89c-4019-a917-fb1517105db5\") " pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.121800 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.121767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:44.262848 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.262826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"]
Jul 12 14:53:44.264435 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:44.264409    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2924de04_a89c_4019_a917_fb1517105db5.slice/crio-7e1266a4bf0238807f8411afd4867d52a4a8cf69c34da36680e6e09655f4cb6e WatchSource:0}: Error finding container 7e1266a4bf0238807f8411afd4867d52a4a8cf69c34da36680e6e09655f4cb6e: Status 404 returned error can't find the container with id 7e1266a4bf0238807f8411afd4867d52a4a8cf69c34da36680e6e09655f4cb6e
Jul 12 14:53:44.285845 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.285808    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85rmf"]
Jul 12 14:53:44.291707 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.291684    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.294084 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.294057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 12 14:53:44.298937 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.298913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85rmf"]
Jul 12 14:53:44.305439 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.305417    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-htz2v"]
Jul 12 14:53:44.309495 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.309476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.311811 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.311793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-48rxh\""
Jul 12 14:53:44.320056 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.320036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-htz2v"]
Jul 12 14:53:44.350309 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.350278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:53:44.438019 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.437935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2w4w\" (UniqueName: \"kubernetes.io/projected/61143cf5-51ef-421f-90b3-820a2a9db90d-kube-api-access-q2w4w\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.438019 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.437977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f991202c-4b37-42fe-9744-875397ea7136-plugins-config-volume\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.438284 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.438084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99x7\" (UniqueName: \"kubernetes.io/projected/f991202c-4b37-42fe-9744-875397ea7136-kube-api-access-v99x7\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.438284 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.438196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61143cf5-51ef-421f-90b3-820a2a9db90d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.539603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.539568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2w4w\" (UniqueName: \"kubernetes.io/projected/61143cf5-51ef-421f-90b3-820a2a9db90d-kube-api-access-q2w4w\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.539603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.539610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f991202c-4b37-42fe-9744-875397ea7136-plugins-config-volume\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.539820 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.539675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99x7\" (UniqueName: \"kubernetes.io/projected/f991202c-4b37-42fe-9744-875397ea7136-kube-api-access-v99x7\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.539820 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.539716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61143cf5-51ef-421f-90b3-820a2a9db90d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.540394 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.540375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f991202c-4b37-42fe-9744-875397ea7136-plugins-config-volume\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.540455 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.540438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61143cf5-51ef-421f-90b3-820a2a9db90d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.547364 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.547341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2w4w\" (UniqueName: \"kubernetes.io/projected/61143cf5-51ef-421f-90b3-820a2a9db90d-kube-api-access-q2w4w\") pod \"payload-pre-processing-7964457696-85rmf\" (UID: \"61143cf5-51ef-421f-90b3-820a2a9db90d\") " pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.547476 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.547415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99x7\" (UniqueName: \"kubernetes.io/projected/f991202c-4b37-42fe-9744-875397ea7136-kube-api-access-v99x7\") pod \"payload-processing-58f86c7798-htz2v\" (UID: \"f991202c-4b37-42fe-9744-875397ea7136\") " pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.605521 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.605489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:44.621446 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.621413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:44.707788 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.707746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj" event={"ID":"2924de04-a89c-4019-a917-fb1517105db5","Type":"ContainerStarted","Data":"7e1266a4bf0238807f8411afd4867d52a4a8cf69c34da36680e6e09655f4cb6e"}
Jul 12 14:53:44.748706 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.748675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85rmf"]
Jul 12 14:53:44.752856 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:44.752832    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61143cf5_51ef_421f_90b3_820a2a9db90d.slice/crio-70e77b8dfe35a00ee2a52ecbc9fe3ca13e6760572547cefdf507fee0691592a1 WatchSource:0}: Error finding container 70e77b8dfe35a00ee2a52ecbc9fe3ca13e6760572547cefdf507fee0691592a1: Status 404 returned error can't find the container with id 70e77b8dfe35a00ee2a52ecbc9fe3ca13e6760572547cefdf507fee0691592a1
Jul 12 14:53:44.776526 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:44.776503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-htz2v"]
Jul 12 14:53:44.778702 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:44.778674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf991202c_4b37_42fe_9744_875397ea7136.slice/crio-e91b9528c2541180ef57d05fc4ee048eae24896df77c104b07e640f0e3832b24 WatchSource:0}: Error finding container e91b9528c2541180ef57d05fc4ee048eae24896df77c104b07e640f0e3832b24: Status 404 returned error can't find the container with id e91b9528c2541180ef57d05fc4ee048eae24896df77c104b07e640f0e3832b24
Jul 12 14:53:45.718293 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:45.718204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-htz2v" event={"ID":"f991202c-4b37-42fe-9744-875397ea7136","Type":"ContainerStarted","Data":"e91b9528c2541180ef57d05fc4ee048eae24896df77c104b07e640f0e3832b24"}
Jul 12 14:53:45.720544 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:45.720481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf" event={"ID":"61143cf5-51ef-421f-90b3-820a2a9db90d","Type":"ContainerStarted","Data":"70e77b8dfe35a00ee2a52ecbc9fe3ca13e6760572547cefdf507fee0691592a1"}
Jul 12 14:53:46.726967 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.726929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj" event={"ID":"2924de04-a89c-4019-a917-fb1517105db5","Type":"ContainerStarted","Data":"f6f28aa8be2a4e474c1605123371bc2a3e4b4940f38ff54150674c7788208ed3"}
Jul 12 14:53:46.727466 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.727110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:46.728894 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.728859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-htz2v" event={"ID":"f991202c-4b37-42fe-9744-875397ea7136","Type":"ContainerStarted","Data":"e9e8bceae75d505dcc21ade6e4ea399465f725d4c43b7c958fc235201401fd09"}
Jul 12 14:53:46.729434 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.729410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:46.733290 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.733259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf" event={"ID":"61143cf5-51ef-421f-90b3-820a2a9db90d","Type":"ContainerStarted","Data":"b8443b0490033cdb5047ba69a92a3ca047886a31da68b1094ec6e990a1790179"}
Jul 12 14:53:46.733778 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.733754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:46.764301 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.764239    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj" podStartSLOduration=1.494971554 podStartE2EDuration="3.764217706s" totalImagesPullingTime="2.269246152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:53:46.746316671 +0000 UTC m=+753.636461458" watchObservedRunningTime="2026-07-12 14:53:46.764217706 +0000 UTC m=+753.654362492"
Jul 12 14:53:46.764486 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.764364    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf" podStartSLOduration=0.984560353 podStartE2EDuration="2.764355182s" totalImagesPullingTime="1.779794829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:53:46.762387293 +0000 UTC m=+753.652532083" watchObservedRunningTime="2026-07-12 14:53:46.764355182 +0000 UTC m=+753.654499968"
Jul 12 14:53:46.778785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:46.778684    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-htz2v" podStartSLOduration=1.018095526 podStartE2EDuration="2.778665588s" totalImagesPullingTime="1.760570062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:53:46.776708593 +0000 UTC m=+753.666853379" watchObservedRunningTime="2026-07-12 14:53:46.778665588 +0000 UTC m=+753.668810377"
Jul 12 14:53:52.747491 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.747458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84b6b4b759-glhmj"
Jul 12 14:53:52.770204 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.770174    2581 generic.go:356] "Generic (PLEG): container finished" podID="cdd94a84-e5f7-4ebd-8882-8750beeca880" containerID="ea8699a4b9bc15ab39b1695bf6f59298aba760584754ff10883d6e9468da784c" exitCode=0
Jul 12 14:53:52.770353 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.770247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" event={"ID":"cdd94a84-e5f7-4ebd-8882-8750beeca880","Type":"ContainerDied","Data":"ea8699a4b9bc15ab39b1695bf6f59298aba760584754ff10883d6e9468da784c"}
Jul 12 14:53:52.770615 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.770602    2581 scope.go:117] "RemoveContainer" containerID="ea8699a4b9bc15ab39b1695bf6f59298aba760584754ff10883d6e9468da784c"
Jul 12 14:53:52.771554 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.771528    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:53:52.771663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.771604    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:53:52.771663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:52.771652    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 14:53:53.776956 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:53.776917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" event={"ID":"cdd94a84-e5f7-4ebd-8882-8750beeca880","Type":"ContainerStarted","Data":"ee11bd0e2029268ba9185fb6436e3d3b485e18d962be896540d6ba6becaf4793"}
Jul 12 14:53:54.195389 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:54.195356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:53:54.195551 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:54.195534    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 12 14:53:54.195603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:54.195584    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" podUID="cdd94a84-e5f7-4ebd-8882-8750beeca880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 12 14:53:55.195950 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:55.195914    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 12 14:53:55.196356 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:55.195974    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" podUID="cdd94a84-e5f7-4ebd-8882-8750beeca880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 12 14:53:56.195507 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:56.195471    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 12 14:53:56.195686 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:56.195526    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" podUID="cdd94a84-e5f7-4ebd-8882-8750beeca880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 12 14:53:57.196273 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:57.196231    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 12 14:53:57.196664 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:57.196289    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd" podUID="cdd94a84-e5f7-4ebd-8882-8750beeca880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 12 14:53:58.199527 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:58.199497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:53:58.199987 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:58.199798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:53:58.200399 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:58.200380    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwcdd"
Jul 12 14:53:58.750224 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:58.750196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-htz2v"
Jul 12 14:53:58.750445 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:58.750275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-85rmf"
Jul 12 14:53:59.395276 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.395240    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"]
Jul 12 14:53:59.399449 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.399426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.402035 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.402004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nfnm5\""
Jul 12 14:53:59.402177 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.402035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 14:53:59.402512 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.402493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 12 14:53:59.402616 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.402516    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 14:53:59.411060 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.411034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"]
Jul 12 14:53:59.486439 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.486596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.486596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.486596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.486596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkpc8\" (UniqueName: \"kubernetes.io/projected/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-kube-api-access-zkpc8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.486596 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.486572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587518 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkpc8\" (UniqueName: \"kubernetes.io/projected/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-kube-api-access-zkpc8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.587785 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.587749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.588089 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.588057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.588221 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.588058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.588221 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.588164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.589740 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.589724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.590071 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.590054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.595170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.595151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkpc8\" (UniqueName: \"kubernetes.io/projected/f0ba44e6-2258-40e8-9ce7-7be91987a0fa-kube-api-access-zkpc8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps\" (UID: \"f0ba44e6-2258-40e8-9ce7-7be91987a0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.712859 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.712780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:53:59.845986 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.845950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:53:59.850651 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:53:59.850631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"]
Jul 12 14:53:59.852961 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:53:59.852934    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ba44e6_2258_40e8_9ce7_7be91987a0fa.slice/crio-722013818b31e7a6bd87080090ae6dabe6a9b3f6dc54609685d2e1d6a66817d7 WatchSource:0}: Error finding container 722013818b31e7a6bd87080090ae6dabe6a9b3f6dc54609685d2e1d6a66817d7: Status 404 returned error can't find the container with id 722013818b31e7a6bd87080090ae6dabe6a9b3f6dc54609685d2e1d6a66817d7
Jul 12 14:54:00.820688 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:00.820648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps" event={"ID":"f0ba44e6-2258-40e8-9ce7-7be91987a0fa","Type":"ContainerStarted","Data":"722013818b31e7a6bd87080090ae6dabe6a9b3f6dc54609685d2e1d6a66817d7"}
Jul 12 14:54:01.828305 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:01.828270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps" event={"ID":"f0ba44e6-2258-40e8-9ce7-7be91987a0fa","Type":"ContainerStarted","Data":"81066c54f920a1d18b72cea9cdb7bf7dc1d37773a791cb6c2623797cce6d010f"}
Jul 12 14:54:01.845343 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:01.845293    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps" podStartSLOduration=1.6672553639999999 podStartE2EDuration="2.845278059s" totalImagesPullingTime="1.178022695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:54:01.844158752 +0000 UTC m=+768.734303537" watchObservedRunningTime="2026-07-12 14:54:01.845278059 +0000 UTC m=+768.735422844"
Jul 12 14:54:09.713742 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:09.713703    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:54:09.714163 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:09.713762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:54:09.726333 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:09.726310    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:54:09.880475 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:09.880449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps"
Jul 12 14:54:11.542135 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:11.542088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:54:34.455687 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:34.455650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:54:45.149209 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:45.149170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:54:47.175621 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.175586    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"]
Jul 12 14:54:47.179340 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.179318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.181421 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.181399    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 12 14:54:47.187848 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.187830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"]
Jul 12 14:54:47.227750 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.227909 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.227909 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.227909 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.227909 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62jzl\" (UniqueName: \"kubernetes.io/projected/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-kube-api-access-62jzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.228094 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.227955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.328810 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.328766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.328810 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.328809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.328834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62jzl\" (UniqueName: \"kubernetes.io/projected/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-kube-api-access-62jzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.328892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.328991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329058 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.329024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329301 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.329287    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329359 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.329316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.329476 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.329453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.331257 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.331233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.331345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.331332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.335803 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.335783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62jzl\" (UniqueName: \"kubernetes.io/projected/e67d0db7-419f-4ea3-9d23-bdf3c32a771e-kube-api-access-62jzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vwvl\" (UID: \"e67d0db7-419f-4ea3-9d23-bdf3c32a771e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.491063 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.490982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:47.621163 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:47.621117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"]
Jul 12 14:54:47.624710 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:54:47.624680    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67d0db7_419f_4ea3_9d23_bdf3c32a771e.slice/crio-11638a5ed612b948bce35b4b3c8de7c11d5f7dd85bfdc14262a6ffd97e2f1529 WatchSource:0}: Error finding container 11638a5ed612b948bce35b4b3c8de7c11d5f7dd85bfdc14262a6ffd97e2f1529: Status 404 returned error can't find the container with id 11638a5ed612b948bce35b4b3c8de7c11d5f7dd85bfdc14262a6ffd97e2f1529
Jul 12 14:54:48.058321 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:48.058289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl" event={"ID":"e67d0db7-419f-4ea3-9d23-bdf3c32a771e","Type":"ContainerStarted","Data":"2e8a973c96ca53d9c81aa4971de46540dea59c6e4255e62eaa7c9da55dcabca5"}
Jul 12 14:54:48.058477 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:48.058351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl" event={"ID":"e67d0db7-419f-4ea3-9d23-bdf3c32a771e","Type":"ContainerStarted","Data":"11638a5ed612b948bce35b4b3c8de7c11d5f7dd85bfdc14262a6ffd97e2f1529"}
Jul 12 14:54:48.075478 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:48.075422    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl" podStartSLOduration=0.916200063 podStartE2EDuration="1.07540494s" totalImagesPullingTime="159.204877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:54:48.074018756 +0000 UTC m=+814.964163542" watchObservedRunningTime="2026-07-12 14:54:48.07540494 +0000 UTC m=+814.965549758"
Jul 12 14:54:53.845087 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:53.845050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:54:57.491214 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:57.491172    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:57.491595 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:57.491252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:57.503712 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:57.503685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:54:58.119464 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:54:58.119436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vwvl"
Jul 12 14:55:01.085241 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.085206    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"]
Jul 12 14:55:01.089528 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.089505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.091550 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.091522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 14:55:01.097718 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.097693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"]
Jul 12 14:55:01.161570 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.161733 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sghdv\" (UniqueName: \"kubernetes.io/projected/16fa2eab-76a8-4502-bfe7-581eb3997ffa-kube-api-access-sghdv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.161733 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.161733 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.161839 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.161839 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.161787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262444 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sghdv\" (UniqueName: \"kubernetes.io/projected/16fa2eab-76a8-4502-bfe7-581eb3997ffa-kube-api-access-sghdv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262626 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262831 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.262980 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.263053 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.262956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.263104 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.263051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.264692 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.264671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fa2eab-76a8-4502-bfe7-581eb3997ffa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.264934 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.264915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fa2eab-76a8-4502-bfe7-581eb3997ffa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.270849 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.270829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sghdv\" (UniqueName: \"kubernetes.io/projected/16fa2eab-76a8-4502-bfe7-581eb3997ffa-kube-api-access-sghdv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz\" (UID: \"16fa2eab-76a8-4502-bfe7-581eb3997ffa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.401843 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.401756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:01.534069 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:01.534042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"]
Jul 12 14:55:01.535797 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:55:01.535767    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16fa2eab_76a8_4502_bfe7_581eb3997ffa.slice/crio-5ce43f53941260bc4e143d3da06c2c5e9fb041aabb528e1d1fbd1f48300cdc8e WatchSource:0}: Error finding container 5ce43f53941260bc4e143d3da06c2c5e9fb041aabb528e1d1fbd1f48300cdc8e: Status 404 returned error can't find the container with id 5ce43f53941260bc4e143d3da06c2c5e9fb041aabb528e1d1fbd1f48300cdc8e
Jul 12 14:55:02.130019 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:02.129983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz" event={"ID":"16fa2eab-76a8-4502-bfe7-581eb3997ffa","Type":"ContainerStarted","Data":"1aa591db261aabf9b8898b94505c5aa2ef5462507110175753647bcaceaed175"}
Jul 12 14:55:02.130420 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:02.130032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz" event={"ID":"16fa2eab-76a8-4502-bfe7-581eb3997ffa","Type":"ContainerStarted","Data":"5ce43f53941260bc4e143d3da06c2c5e9fb041aabb528e1d1fbd1f48300cdc8e"}
Jul 12 14:55:02.148284 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:02.148234    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz" podStartSLOduration=0.947309623 podStartE2EDuration="1.148215161s" totalImagesPullingTime="200.905538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:55:02.146097603 +0000 UTC m=+829.036242390" watchObservedRunningTime="2026-07-12 14:55:02.148215161 +0000 UTC m=+829.038359947"
Jul 12 14:55:03.647345 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:03.647311    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:55:11.402300 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:11.402262    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:11.402300 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:11.402309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:11.414948 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:11.414918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:55:12.189192 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:55:12.189162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz"
Jul 12 14:56:13.551697 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:56:13.551622    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:56:13.552587 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:56:13.552568    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 14:57:31.541084 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:57:31.541041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:57:40.742779 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:57:40.742744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:57:51.744638 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:57:51.744597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:58:00.842983 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:00.842939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:58:11.148786 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:11.148750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:58:14.045944 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.045904    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:58:14.046446 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.046151    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" podUID="f04038d4-5a29-4d96-84fe-41643213ff99" containerName="manager" containerID="cri-o://1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05" gracePeriod=30
Jul 12 14:58:14.306603 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.306528    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:58:14.479756 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.479722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert\") pod \"f04038d4-5a29-4d96-84fe-41643213ff99\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") "
Jul 12 14:58:14.479981 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.479772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppm5m\" (UniqueName: \"kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m\") pod \"f04038d4-5a29-4d96-84fe-41643213ff99\" (UID: \"f04038d4-5a29-4d96-84fe-41643213ff99\") "
Jul 12 14:58:14.481879 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.481844    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f04038d4-5a29-4d96-84fe-41643213ff99" (UID: "f04038d4-5a29-4d96-84fe-41643213ff99"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 14:58:14.481997 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.481916    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m" (OuterVolumeSpecName: "kube-api-access-ppm5m") pod "f04038d4-5a29-4d96-84fe-41643213ff99" (UID: "f04038d4-5a29-4d96-84fe-41643213ff99"). InnerVolumeSpecName "kube-api-access-ppm5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 14:58:14.580687 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.580639    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04038d4-5a29-4d96-84fe-41643213ff99-webhook-cert\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:58:14.580687 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:14.580684    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppm5m\" (UniqueName: \"kubernetes.io/projected/f04038d4-5a29-4d96-84fe-41643213ff99-kube-api-access-ppm5m\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 14:58:15.105170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.105114    2581 generic.go:356] "Generic (PLEG): container finished" podID="f04038d4-5a29-4d96-84fe-41643213ff99" containerID="1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05" exitCode=0
Jul 12 14:58:15.105170 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.105171    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-k7jlt"
Jul 12 14:58:15.105663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.105197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" event={"ID":"f04038d4-5a29-4d96-84fe-41643213ff99","Type":"ContainerDied","Data":"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"}
Jul 12 14:58:15.105663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.105253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-k7jlt" event={"ID":"f04038d4-5a29-4d96-84fe-41643213ff99","Type":"ContainerDied","Data":"341bea542ef4a54511b98df8fc0b72e095794b357a2fe4b067621633619f626f"}
Jul 12 14:58:15.105663 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.105276    2581 scope.go:117] "RemoveContainer" containerID="1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"
Jul 12 14:58:15.116360 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.116336    2581 scope.go:117] "RemoveContainer" containerID="1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"
Jul 12 14:58:15.116673 ip-10-0-139-143 kubenswrapper[2581]: E0712 14:58:15.116650    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05\": container with ID starting with 1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05 not found: ID does not exist" containerID="1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"
Jul 12 14:58:15.116723 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.116682    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05"} err="failed to get container status \"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05\": rpc error: code = NotFound desc = could not find container \"1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05\": container with ID starting with 1e7420fc8943f5d4e5a690f63e2bf1078c558d46b407f729ce0d769485a1be05 not found: ID does not exist"
Jul 12 14:58:15.127824 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.127788    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:58:15.133296 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.133272    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-k7jlt"]
Jul 12 14:58:15.612370 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.612341    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04038d4-5a29-4d96-84fe-41643213ff99" path="/var/lib/kubelet/pods/f04038d4-5a29-4d96-84fe-41643213ff99/volumes"
Jul 12 14:58:15.865295 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.865209    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fd9449f55-f76fz"]
Jul 12 14:58:15.865636 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.865624    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04038d4-5a29-4d96-84fe-41643213ff99" containerName="manager"
Jul 12 14:58:15.865702 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.865638    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04038d4-5a29-4d96-84fe-41643213ff99" containerName="manager"
Jul 12 14:58:15.865742 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.865707    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04038d4-5a29-4d96-84fe-41643213ff99" containerName="manager"
Jul 12 14:58:15.870104 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.870080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:15.872747 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.872726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 14:58:15.872868 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.872757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 14:58:15.873515 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.873362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5j98t\""
Jul 12 14:58:15.878921 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.878894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-f76fz"]
Jul 12 14:58:15.892444 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.892415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e20e708-7a66-4f30-b0cd-34caae45c5a1-webhook-cert\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:15.892562 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.892463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht5nr\" (UniqueName: \"kubernetes.io/projected/8e20e708-7a66-4f30-b0cd-34caae45c5a1-kube-api-access-ht5nr\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:15.993489 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.993443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e20e708-7a66-4f30-b0cd-34caae45c5a1-webhook-cert\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:15.993672 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.993508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht5nr\" (UniqueName: \"kubernetes.io/projected/8e20e708-7a66-4f30-b0cd-34caae45c5a1-kube-api-access-ht5nr\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:15.995981 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:15.995950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e20e708-7a66-4f30-b0cd-34caae45c5a1-webhook-cert\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:16.000874 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:16.000845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht5nr\" (UniqueName: \"kubernetes.io/projected/8e20e708-7a66-4f30-b0cd-34caae45c5a1-kube-api-access-ht5nr\") pod \"maas-controller-5fd9449f55-f76fz\" (UID: \"8e20e708-7a66-4f30-b0cd-34caae45c5a1\") " pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:16.189562 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:16.189465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:16.325441 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:16.325417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd9449f55-f76fz"]
Jul 12 14:58:16.327047 ip-10-0-139-143 kubenswrapper[2581]: W0712 14:58:16.327019    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e20e708_7a66_4f30_b0cd_34caae45c5a1.slice/crio-6e9f00dc101622dab06138044ddb4ebfee974a59693488cf99b14b6940cb0c64 WatchSource:0}: Error finding container 6e9f00dc101622dab06138044ddb4ebfee974a59693488cf99b14b6940cb0c64: Status 404 returned error can't find the container with id 6e9f00dc101622dab06138044ddb4ebfee974a59693488cf99b14b6940cb0c64
Jul 12 14:58:16.328447 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:16.328427    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 14:58:17.119701 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:17.119600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-f76fz" event={"ID":"8e20e708-7a66-4f30-b0cd-34caae45c5a1","Type":"ContainerStarted","Data":"01e6657463baf5532633973270ad81ecc89c512aff70a7fcd0333193226dd535"}
Jul 12 14:58:17.119701 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:17.119664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd9449f55-f76fz" event={"ID":"8e20e708-7a66-4f30-b0cd-34caae45c5a1","Type":"ContainerStarted","Data":"6e9f00dc101622dab06138044ddb4ebfee974a59693488cf99b14b6940cb0c64"}
Jul 12 14:58:17.119701 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:17.119693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:17.135866 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:17.135813    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fd9449f55-f76fz" podStartSLOduration=1.627449017 podStartE2EDuration="2.135798005s" totalImagesPullingTime="508.348988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 14:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 14:58:17.134521481 +0000 UTC m=+1024.024666267" watchObservedRunningTime="2026-07-12 14:58:17.135798005 +0000 UTC m=+1024.025942790"
Jul 12 14:58:28.131678 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:28.131642    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fd9449f55-f76fz"
Jul 12 14:58:38.653752 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:38.653713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:58:50.341427 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:58:50.341394    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:59:25.937863 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:59:25.937825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:59:35.439075 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:59:35.439040    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:59:45.845388 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:59:45.845348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 14:59:52.938329 ip-10-0-139-143 kubenswrapper[2581]: I0712 14:59:52.938293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:02.953086 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:02.953043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:14.351587 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:14.351549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:25.353038 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:25.353000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:33.049422 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:33.049387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:40.547481 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:40.547438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:00:48.445800 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:00:48.445765    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:01:03.353442 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:03.353406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:01:13.583086 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:13.583055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:01:13.584794 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:13.584771    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:01:15.643024 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:15.642989    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:01:38.156373 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:38.156342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:01:48.439522 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:01:48.439488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:02:03.470386 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:02:03.470344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:02:14.547372 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:02:14.547279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:02:24.548861 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:02:24.548825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:02:34.145565 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:02:34.145528    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:02:43.852361 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:02:43.852326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:04:30.551284 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:04:30.551252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:04:42.447760 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:04:42.447724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:04:50.651884 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:04:50.651845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:01.254869 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:01.254827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:11.945935 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:11.945850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:22.548917 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:22.548881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:31.641404 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:31.641369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:42.151816 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:42.151778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:05:52.851199 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:05:52.851163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:06:02.954396 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:02.954358    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:06:13.618286 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:13.618254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:06:13.619989 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:13.619957    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:06:14.245101 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:14.245066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:06:36.755388 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:36.755301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:06:47.352692 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:47.352652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:06:57.847341 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:06:57.847299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:06.953277 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:06.953228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:16.252662 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:16.252624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:27.840946 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:27.840908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:38.438839 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:38.438802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:47.248095 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:47.248048    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:07:55.838786 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:07:55.838751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:06.560201 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:06.560098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:15.545664 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:15.545625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:28.199102 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:28.199067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:36.753033 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:36.752993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:45.242056 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:45.242016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:08:54.643426 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:08:54.643388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:09:06.445871 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:09:06.445838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:09:14.448923 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:09:14.448889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:09:27.048041 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:09:27.048003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:09:38.843601 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:09:38.843505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:09:51.039200 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:09:51.039156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:10:02.624778 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.624744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:02.628470 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.628449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.630768 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.630747    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-91d5d23f-serving-cert\""
Jul 12 15:10:02.638996 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.638966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:02.743715 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.743681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.743715 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.743713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bpxr\" (UniqueName: \"kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.743956 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.743763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.844898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.844863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.844898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.844904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bpxr\" (UniqueName: \"kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.845147 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.844959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.845147 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:02.845115    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-serving-cert: secret "maas-api-e2e-ait-91d5d23f-serving-cert" not found
Jul 12 15:10:02.845264 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:02.845240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls podName:445713e3-393d-480d-95c5-9606d25d84ae nodeName:}" failed. No retries permitted until 2026-07-12 15:10:03.345183416 +0000 UTC m=+1730.235328181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls") pod "maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" (UID: "445713e3-393d-480d-95c5-9606d25d84ae") : secret "maas-api-e2e-ait-91d5d23f-serving-cert" not found
Jul 12 15:10:02.845715 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.845692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:02.855157 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:02.855091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bpxr\" (UniqueName: \"kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:03.349850 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.349807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:03.352473 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.352436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") pod \"maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:03.541269 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.541221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:03.685081 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.685050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:03.687016 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:10:03.686986    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445713e3_393d_480d_95c5_9606d25d84ae.slice/crio-2898c019ff87bf9f397f2f3e8979db64bced4dc45b4f50c83f117c3faa935f93 WatchSource:0}: Error finding container 2898c019ff87bf9f397f2f3e8979db64bced4dc45b4f50c83f117c3faa935f93: Status 404 returned error can't find the container with id 2898c019ff87bf9f397f2f3e8979db64bced4dc45b4f50c83f117c3faa935f93
Jul 12 15:10:03.688466 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.688435    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:10:03.742327 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:03.742291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" event={"ID":"445713e3-393d-480d-95c5-9606d25d84ae","Type":"ContainerStarted","Data":"2898c019ff87bf9f397f2f3e8979db64bced4dc45b4f50c83f117c3faa935f93"}
Jul 12 15:10:04.748846 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:04.748810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" event={"ID":"445713e3-393d-480d-95c5-9606d25d84ae","Type":"ContainerStarted","Data":"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"}
Jul 12 15:10:04.749276 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:04.748877    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:04.764243 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:04.764189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" podStartSLOduration=2.164885771 podStartE2EDuration="2.764174061s" totalImagesPullingTime="599.28829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:04.762978922 +0000 UTC m=+1731.653123709" watchObservedRunningTime="2026-07-12 15:10:04.764174061 +0000 UTC m=+1731.654318922"
Jul 12 15:10:04.940565 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:04.940522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:10:08.090064 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.090027    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:08.090568 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.090284    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" podUID="445713e3-393d-480d-95c5-9606d25d84ae" containerName="maas-api" containerID="cri-o://4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc" gracePeriod=30
Jul 12 15:10:08.353404 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.353337    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:08.502795 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.502736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bpxr\" (UniqueName: \"kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr\") pod \"445713e3-393d-480d-95c5-9606d25d84ae\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") "
Jul 12 15:10:08.503001 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.502811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") pod \"445713e3-393d-480d-95c5-9606d25d84ae\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") "
Jul 12 15:10:08.503072 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.503021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca\") pod \"445713e3-393d-480d-95c5-9606d25d84ae\" (UID: \"445713e3-393d-480d-95c5-9606d25d84ae\") "
Jul 12 15:10:08.503459 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.503430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "445713e3-393d-480d-95c5-9606d25d84ae" (UID: "445713e3-393d-480d-95c5-9606d25d84ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:10:08.505084 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.505054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "445713e3-393d-480d-95c5-9606d25d84ae" (UID: "445713e3-393d-480d-95c5-9606d25d84ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:10:08.505205 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.505141    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr" (OuterVolumeSpecName: "kube-api-access-4bpxr") pod "445713e3-393d-480d-95c5-9606d25d84ae" (UID: "445713e3-393d-480d-95c5-9606d25d84ae"). InnerVolumeSpecName "kube-api-access-4bpxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:10:08.604251 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.604154    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bpxr\" (UniqueName: \"kubernetes.io/projected/445713e3-393d-480d-95c5-9606d25d84ae-kube-api-access-4bpxr\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:08.604251 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.604189    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445713e3-393d-480d-95c5-9606d25d84ae-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:08.604251 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.604199    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445713e3-393d-480d-95c5-9606d25d84ae-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:08.770988 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.770955    2581 generic.go:356] "Generic (PLEG): container finished" podID="445713e3-393d-480d-95c5-9606d25d84ae" containerID="4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc" exitCode=0
Jul 12 15:10:08.771190 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.771001    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"
Jul 12 15:10:08.771190 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.771002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" event={"ID":"445713e3-393d-480d-95c5-9606d25d84ae","Type":"ContainerDied","Data":"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"}
Jul 12 15:10:08.771190 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.771158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc" event={"ID":"445713e3-393d-480d-95c5-9606d25d84ae","Type":"ContainerDied","Data":"2898c019ff87bf9f397f2f3e8979db64bced4dc45b4f50c83f117c3faa935f93"}
Jul 12 15:10:08.771190 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.771187    2581 scope.go:117] "RemoveContainer" containerID="4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"
Jul 12 15:10:08.780825 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.780802    2581 scope.go:117] "RemoveContainer" containerID="4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"
Jul 12 15:10:08.781152 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:08.781106    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc\": container with ID starting with 4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc not found: ID does not exist" containerID="4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"
Jul 12 15:10:08.781258 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.781160    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc"} err="failed to get container status \"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc\": rpc error: code = NotFound desc = could not find container \"4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc\": container with ID starting with 4e15e0f2bf08df2db67b24ffb3a1126892395acf6750c2ddf612109eea3221dc not found: ID does not exist"
Jul 12 15:10:08.791437 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.791406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:08.793308 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:08.793287    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91d5d23f-5d7898f6dd-lvhrc"]
Jul 12 15:10:09.611961 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:09.611925    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445713e3-393d-480d-95c5-9606d25d84ae" path="/var/lib/kubelet/pods/445713e3-393d-480d-95c5-9606d25d84ae/volumes"
Jul 12 15:10:13.650513 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:13.650476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:10:15.019744 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.019710    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:15.020387 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.020360    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445713e3-393d-480d-95c5-9606d25d84ae" containerName="maas-api"
Jul 12 15:10:15.020387 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.020391    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="445713e3-393d-480d-95c5-9606d25d84ae" containerName="maas-api"
Jul 12 15:10:15.020566 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.020503    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="445713e3-393d-480d-95c5-9606d25d84ae" containerName="maas-api"
Jul 12 15:10:15.023364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.023346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.025559 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.025535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-61e6b661-serving-cert\""
Jul 12 15:10:15.036362 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.036338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:15.064687 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.064648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.064847 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.064710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgglw\" (UniqueName: \"kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.064847 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.064734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.166208 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.166167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.166392 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.166252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgglw\" (UniqueName: \"kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.166392 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.166279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.166826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.166795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.168915 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.168888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.176583 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.176560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgglw\" (UniqueName: \"kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw\") pod \"maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.337814 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.337781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:15.474167 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.474140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:15.475931 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:10:15.475899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea351fa8_1c8c_4f7f_b149_2219ee58a1a1.slice/crio-67dc6a916c13caf1295eb2fd59fa63675fea61ff898aa7d9c4601e94b513e455 WatchSource:0}: Error finding container 67dc6a916c13caf1295eb2fd59fa63675fea61ff898aa7d9c4601e94b513e455: Status 404 returned error can't find the container with id 67dc6a916c13caf1295eb2fd59fa63675fea61ff898aa7d9c4601e94b513e455
Jul 12 15:10:15.810185 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:15.810151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" event={"ID":"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1","Type":"ContainerStarted","Data":"67dc6a916c13caf1295eb2fd59fa63675fea61ff898aa7d9c4601e94b513e455"}
Jul 12 15:10:16.816440 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:16.816403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" event={"ID":"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1","Type":"ContainerStarted","Data":"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"}
Jul 12 15:10:16.816828 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:16.816531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:16.833513 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:16.833460    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" podStartSLOduration=1.3458046719999999 podStartE2EDuration="1.833444414s" totalImagesPullingTime="487.639742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:16.831635621 +0000 UTC m=+1743.721780407" watchObservedRunningTime="2026-07-12 15:10:16.833444414 +0000 UTC m=+1743.723589199"
Jul 12 15:10:20.485951 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.485913    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:20.486441 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.486160    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" podUID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" containerName="maas-api" containerID="cri-o://18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c" gracePeriod=30
Jul 12 15:10:20.747840 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.747758    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:20.824039 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.824003    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca\") pod \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") "
Jul 12 15:10:20.824222 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.824068    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgglw\" (UniqueName: \"kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw\") pod \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") "
Jul 12 15:10:20.824222 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.824188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls\") pod \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\" (UID: \"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1\") "
Jul 12 15:10:20.824419 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.824397    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" (UID: "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:10:20.824531 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.824514    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:20.826199 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.826177    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" (UID: "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:10:20.826283 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.826232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw" (OuterVolumeSpecName: "kube-api-access-hgglw") pod "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" (UID: "ea351fa8-1c8c-4f7f-b149-2219ee58a1a1"). InnerVolumeSpecName "kube-api-access-hgglw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:10:20.837906 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.837880    2581 generic.go:356] "Generic (PLEG): container finished" podID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" containerID="18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c" exitCode=0
Jul 12 15:10:20.838059 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.837923    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"
Jul 12 15:10:20.838059 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.837963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" event={"ID":"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1","Type":"ContainerDied","Data":"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"}
Jul 12 15:10:20.838059 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.838020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44" event={"ID":"ea351fa8-1c8c-4f7f-b149-2219ee58a1a1","Type":"ContainerDied","Data":"67dc6a916c13caf1295eb2fd59fa63675fea61ff898aa7d9c4601e94b513e455"}
Jul 12 15:10:20.838059 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.838052    2581 scope.go:117] "RemoveContainer" containerID="18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"
Jul 12 15:10:20.848047 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.848027    2581 scope.go:117] "RemoveContainer" containerID="18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"
Jul 12 15:10:20.848372 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:20.848350    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c\": container with ID starting with 18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c not found: ID does not exist" containerID="18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"
Jul 12 15:10:20.848457 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.848381    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c"} err="failed to get container status \"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c\": rpc error: code = NotFound desc = could not find container \"18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c\": container with ID starting with 18f602389e18bfa2502d7254b07b75c7a60b600a8d51b339712fe20a92b0d32c not found: ID does not exist"
Jul 12 15:10:20.857188 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.857163    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:20.860780 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.860757    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61e6b661-646bf59f6c-bdz44"]
Jul 12 15:10:20.925364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.925321    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgglw\" (UniqueName: \"kubernetes.io/projected/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-kube-api-access-hgglw\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:20.925364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:20.925356    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:21.611488 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:21.611449    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" path="/var/lib/kubelet/pods/ea351fa8-1c8c-4f7f-b149-2219ee58a1a1/volumes"
Jul 12 15:10:33.510290 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.510247    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:33.510938 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.510916    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" containerName="maas-api"
Jul 12 15:10:33.510989 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.510941    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" containerName="maas-api"
Jul 12 15:10:33.511111 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.511097    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea351fa8-1c8c-4f7f-b149-2219ee58a1a1" containerName="maas-api"
Jul 12 15:10:33.516187 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.516165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.519144 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.519109    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9f3615f1-serving-cert\""
Jul 12 15:10:33.524968 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.524145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:33.644886 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.644842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.645076 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.644906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87pr\" (UniqueName: \"kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.645076 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.645017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.746454 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.746409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.746655 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.746502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.746655 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:33.746616    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-serving-cert: secret "maas-api-e2e-derive-9f3615f1-serving-cert" not found
Jul 12 15:10:33.746780 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:33.746718    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls podName:8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:34.246694688 +0000 UTC m=+1761.136839474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls") pod "maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" (UID: "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0") : secret "maas-api-e2e-derive-9f3615f1-serving-cert" not found
Jul 12 15:10:33.746839 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.746801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87pr\" (UniqueName: \"kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.747653 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.747227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:33.756700 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:33.756669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87pr\" (UniqueName: \"kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:34.252093 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:34.252055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:34.254617 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:34.254583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") pod \"maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:34.429012 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:34.428972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:34.572243 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:34.572201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:34.574922 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:10:34.574890    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8897fbbf_54d8_4ee6_8a6b_ccc1c04a4ce0.slice/crio-ad69e303f01badb10e3d5e7625fd2879fb4ee4e1c185ada8c7a793eb8e043627 WatchSource:0}: Error finding container ad69e303f01badb10e3d5e7625fd2879fb4ee4e1c185ada8c7a793eb8e043627: Status 404 returned error can't find the container with id ad69e303f01badb10e3d5e7625fd2879fb4ee4e1c185ada8c7a793eb8e043627
Jul 12 15:10:34.918476 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:34.918444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" event={"ID":"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0","Type":"ContainerStarted","Data":"ad69e303f01badb10e3d5e7625fd2879fb4ee4e1c185ada8c7a793eb8e043627"}
Jul 12 15:10:35.924842 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:35.924804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" event={"ID":"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0","Type":"ContainerStarted","Data":"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"}
Jul 12 15:10:35.925338 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:35.924983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:35.938946 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:35.938890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" podStartSLOduration=2.60518558 podStartE2EDuration="2.938864113s" totalImagesPullingTime="333.678533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:35.938424123 +0000 UTC m=+1762.828568909" watchObservedRunningTime="2026-07-12 15:10:35.938864113 +0000 UTC m=+1762.829008899"
Jul 12 15:10:35.944886 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:35.944809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:10:38.212408 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.212374    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:38.212866 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.212600    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" podUID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" containerName="maas-api" containerID="cri-o://323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec" gracePeriod=30
Jul 12 15:10:38.467143 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.467066    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:38.590992 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.590953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca\") pod \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") "
Jul 12 15:10:38.591194 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.591012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z87pr\" (UniqueName: \"kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr\") pod \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") "
Jul 12 15:10:38.591194 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.591154    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") pod \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\" (UID: \"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0\") "
Jul 12 15:10:38.591426 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.591404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" (UID: "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:10:38.591530 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.591519    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:38.593105 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.593082    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" (UID: "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:10:38.593217 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.593120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr" (OuterVolumeSpecName: "kube-api-access-z87pr") pod "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" (UID: "8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0"). InnerVolumeSpecName "kube-api-access-z87pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:10:38.692250 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.692217    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87pr\" (UniqueName: \"kubernetes.io/projected/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-kube-api-access-z87pr\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:38.692250 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.692247    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:10:38.943017 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.942982    2581 generic.go:356] "Generic (PLEG): container finished" podID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" containerID="323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec" exitCode=0
Jul 12 15:10:38.943221 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.943030    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"
Jul 12 15:10:38.943221 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.943075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" event={"ID":"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0","Type":"ContainerDied","Data":"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"}
Jul 12 15:10:38.943221 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.943142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v" event={"ID":"8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0","Type":"ContainerDied","Data":"ad69e303f01badb10e3d5e7625fd2879fb4ee4e1c185ada8c7a793eb8e043627"}
Jul 12 15:10:38.943221 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.943181    2581 scope.go:117] "RemoveContainer" containerID="323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"
Jul 12 15:10:38.952466 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.952442    2581 scope.go:117] "RemoveContainer" containerID="323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"
Jul 12 15:10:38.952764 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:10:38.952734    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec\": container with ID starting with 323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec not found: ID does not exist" containerID="323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"
Jul 12 15:10:38.952827 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.952767    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec"} err="failed to get container status \"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec\": rpc error: code = NotFound desc = could not find container \"323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec\": container with ID starting with 323f4791a014bde2e630ff6dd401ece3de326815f282d2f78da85cbc66648aec not found: ID does not exist"
Jul 12 15:10:38.967786 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.967745    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:38.967960 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:38.967807    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f3615f1-65f64f9fbb-jnt5v"]
Jul 12 15:10:39.611765 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:39.611727    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" path="/var/lib/kubelet/pods/8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0/volumes"
Jul 12 15:10:44.846306 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:10:44.846267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:11:13.649774 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:11:13.649746    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:11:13.652772 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:11:13.652748    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:12:05.352527 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:05.352490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:12:12.841794 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:12.841759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:12:21.143540 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:21.143499    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:12:22.341575 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.341531    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:22.342249 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.342227    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" containerName="maas-api"
Jul 12 15:12:22.342339 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.342253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" containerName="maas-api"
Jul 12 15:12:22.342405 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.342383    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8897fbbf-54d8-4ee6-8a6b-ccc1c04a4ce0" containerName="maas-api"
Jul 12 15:12:22.345517 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.345500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.347832 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.347812    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea99faec-serving-cert\""
Jul 12 15:12:22.354537 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.354512    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:22.481024 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.480986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.481238 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.481036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845th\" (UniqueName: \"kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.481238 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.481183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.582229 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.582190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.582408 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.582247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845th\" (UniqueName: \"kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.582408 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.582316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.582916 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.582897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.584738 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.584719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.599160 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.599060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-845th\" (UniqueName: \"kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th\") pod \"maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.657690 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.657647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:22.799791 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:22.799760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:22.802495 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:12:22.802463    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018f0e4a_0cc9_49bf_89e3_fa0d86138d2b.slice/crio-5dd74133079ac8501387e3796321f6f99f32c31463ea388dcf9bb9281652ebc0 WatchSource:0}: Error finding container 5dd74133079ac8501387e3796321f6f99f32c31463ea388dcf9bb9281652ebc0: Status 404 returned error can't find the container with id 5dd74133079ac8501387e3796321f6f99f32c31463ea388dcf9bb9281652ebc0
Jul 12 15:12:23.471504 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:23.471465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" event={"ID":"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b","Type":"ContainerStarted","Data":"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"}
Jul 12 15:12:23.471892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:23.471528    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" event={"ID":"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b","Type":"ContainerStarted","Data":"5dd74133079ac8501387e3796321f6f99f32c31463ea388dcf9bb9281652ebc0"}
Jul 12 15:12:23.471892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:23.471650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:23.486652 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:23.486556    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" podStartSLOduration=1.01930037 podStartE2EDuration="1.486533798s" totalImagesPullingTime="467.233428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:12:23.485636216 +0000 UTC m=+1870.375781000" watchObservedRunningTime="2026-07-12 15:12:23.486533798 +0000 UTC m=+1870.376678584"
Jul 12 15:12:29.483102 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:29.483069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:30.658727 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:30.658687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:12:34.439463 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.439422    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:34.439926 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.439669    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerName="maas-api" containerID="cri-o://77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba" gracePeriod=30
Jul 12 15:12:34.477846 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.477800    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.47:8443/health\": dial tcp 10.133.0.47:8443: connect: connection refused"
Jul 12 15:12:34.696924 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.696860    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:34.801534 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.801498    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-845th\" (UniqueName: \"kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th\") pod \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") "
Jul 12 15:12:34.801734 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.801543    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca\") pod \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") "
Jul 12 15:12:34.801734 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.801627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls\") pod \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\" (UID: \"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b\") "
Jul 12 15:12:34.801961 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.801932    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" (UID: "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:12:34.803750 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.803727    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" (UID: "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:12:34.803834 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.803796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th" (OuterVolumeSpecName: "kube-api-access-845th") pod "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" (UID: "018f0e4a-0cc9-49bf-89e3-fa0d86138d2b"). InnerVolumeSpecName "kube-api-access-845th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:12:34.902942 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.902907    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-845th\" (UniqueName: \"kubernetes.io/projected/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-kube-api-access-845th\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:12:34.902942 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.902936    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:12:34.902942 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:34.902946    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:12:35.533411 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.533317    2581 generic.go:356] "Generic (PLEG): container finished" podID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerID="77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba" exitCode=0
Jul 12 15:12:35.533411 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.533363    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"
Jul 12 15:12:35.533411 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.533399    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" event={"ID":"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b","Type":"ContainerDied","Data":"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"}
Jul 12 15:12:35.534000 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.533453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt" event={"ID":"018f0e4a-0cc9-49bf-89e3-fa0d86138d2b","Type":"ContainerDied","Data":"5dd74133079ac8501387e3796321f6f99f32c31463ea388dcf9bb9281652ebc0"}
Jul 12 15:12:35.534000 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.533479    2581 scope.go:117] "RemoveContainer" containerID="77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"
Jul 12 15:12:35.548679 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.548455    2581 scope.go:117] "RemoveContainer" containerID="77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"
Jul 12 15:12:35.548859 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:12:35.548833    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba\": container with ID starting with 77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba not found: ID does not exist" containerID="77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"
Jul 12 15:12:35.548915 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.548873    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba"} err="failed to get container status \"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba\": rpc error: code = NotFound desc = could not find container \"77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba\": container with ID starting with 77623ec1b5cd37aa90ab2f283adc619c55ca50abd19e37a5f33372d2fe2219ba not found: ID does not exist"
Jul 12 15:12:35.561515 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.561485    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:35.565679 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.565652    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea99faec-55fb65c444-qdwjt"]
Jul 12 15:12:35.612453 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:35.612422    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" path="/var/lib/kubelet/pods/018f0e4a-0cc9-49bf-89e3-fa0d86138d2b/volumes"
Jul 12 15:12:37.051264 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:12:37.051227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:13:02.585564 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.585522    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:02.586166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.585948    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerName="maas-api"
Jul 12 15:13:02.586166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.585959    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerName="maas-api"
Jul 12 15:13:02.586166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.586017    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="018f0e4a-0cc9-49bf-89e3-fa0d86138d2b" containerName="maas-api"
Jul 12 15:13:02.589253 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.589231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.594703 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.594681    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-90571a9f-serving-cert\""
Jul 12 15:13:02.601383 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.601356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:02.666534 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.666496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.666534 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.666539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xqx\" (UniqueName: \"kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.666767 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.666714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.768267 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.768227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.768463 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.768290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.768463 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.768307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xqx\" (UniqueName: \"kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.768976 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.768956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.770991 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.770967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.775854 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.775831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xqx\" (UniqueName: \"kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx\") pod \"maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:02.900364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:02.900260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:03.041318 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:03.041258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:03.043783 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:13:03.043753    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a688713_de7c_4a39_aba0_bbefbf364ce5.slice/crio-e2148a182c64dab394ffa40173bed46342eca44798ba3e8eea6b26d97ea895d7 WatchSource:0}: Error finding container e2148a182c64dab394ffa40173bed46342eca44798ba3e8eea6b26d97ea895d7: Status 404 returned error can't find the container with id e2148a182c64dab394ffa40173bed46342eca44798ba3e8eea6b26d97ea895d7
Jul 12 15:13:03.680755 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:03.680659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" event={"ID":"0a688713-de7c-4a39-aba0-bbefbf364ce5","Type":"ContainerStarted","Data":"ea368400632aaba86dbbb562a97a6f2f3de8ce7939e6c10c9e4aa206ea42facf"}
Jul 12 15:13:03.680755 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:03.680720    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" event={"ID":"0a688713-de7c-4a39-aba0-bbefbf364ce5","Type":"ContainerStarted","Data":"e2148a182c64dab394ffa40173bed46342eca44798ba3e8eea6b26d97ea895d7"}
Jul 12 15:13:03.681266 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:03.680785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:03.697551 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:03.697490    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" podStartSLOduration=1.363827636 podStartE2EDuration="1.697474066s" totalImagesPullingTime="333.64643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:13:03.694998339 +0000 UTC m=+1910.585143123" watchObservedRunningTime="2026-07-12 15:13:03.697474066 +0000 UTC m=+1910.587618850"
Jul 12 15:13:08.167759 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:08.167718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:13:09.690681 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:09.690650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:16.442708 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:16.442671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:13:31.856377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:31.856330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:13:34.686325 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.686291    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:34.686813 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.686505    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" podUID="0a688713-de7c-4a39-aba0-bbefbf364ce5" containerName="maas-api" containerID="cri-o://ea368400632aaba86dbbb562a97a6f2f3de8ce7939e6c10c9e4aa206ea42facf" gracePeriod=30
Jul 12 15:13:34.845817 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.845778    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a688713-de7c-4a39-aba0-bbefbf364ce5" containerID="ea368400632aaba86dbbb562a97a6f2f3de8ce7939e6c10c9e4aa206ea42facf" exitCode=0
Jul 12 15:13:34.846006 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.845841    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" event={"ID":"0a688713-de7c-4a39-aba0-bbefbf364ce5","Type":"ContainerDied","Data":"ea368400632aaba86dbbb562a97a6f2f3de8ce7939e6c10c9e4aa206ea42facf"}
Jul 12 15:13:34.945777 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.945706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:34.964738 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.964705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92xqx\" (UniqueName: \"kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx\") pod \"0a688713-de7c-4a39-aba0-bbefbf364ce5\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") "
Jul 12 15:13:34.964900 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.964770    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca\") pod \"0a688713-de7c-4a39-aba0-bbefbf364ce5\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") "
Jul 12 15:13:34.964900 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.964858    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls\") pod \"0a688713-de7c-4a39-aba0-bbefbf364ce5\" (UID: \"0a688713-de7c-4a39-aba0-bbefbf364ce5\") "
Jul 12 15:13:34.965368 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.965341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a688713-de7c-4a39-aba0-bbefbf364ce5" (UID: "0a688713-de7c-4a39-aba0-bbefbf364ce5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:13:34.967388 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.967355    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx" (OuterVolumeSpecName: "kube-api-access-92xqx") pod "0a688713-de7c-4a39-aba0-bbefbf364ce5" (UID: "0a688713-de7c-4a39-aba0-bbefbf364ce5"). InnerVolumeSpecName "kube-api-access-92xqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:13:34.967485 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:34.967412    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a688713-de7c-4a39-aba0-bbefbf364ce5" (UID: "0a688713-de7c-4a39-aba0-bbefbf364ce5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:13:35.065892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.065852    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92xqx\" (UniqueName: \"kubernetes.io/projected/0a688713-de7c-4a39-aba0-bbefbf364ce5-kube-api-access-92xqx\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:13:35.065892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.065885    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a688713-de7c-4a39-aba0-bbefbf364ce5-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:13:35.065892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.065896    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a688713-de7c-4a39-aba0-bbefbf364ce5-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:13:35.851967 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.851928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv" event={"ID":"0a688713-de7c-4a39-aba0-bbefbf364ce5","Type":"ContainerDied","Data":"e2148a182c64dab394ffa40173bed46342eca44798ba3e8eea6b26d97ea895d7"}
Jul 12 15:13:35.851967 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.851953    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"
Jul 12 15:13:35.852463 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.852004    2581 scope.go:117] "RemoveContainer" containerID="ea368400632aaba86dbbb562a97a6f2f3de8ce7939e6c10c9e4aa206ea42facf"
Jul 12 15:13:35.869836 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.869762    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:35.871700 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:35.871680    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-90571a9f-7cd458fb75-cvzzv"]
Jul 12 15:13:37.612064 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:37.612021    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a688713-de7c-4a39-aba0-bbefbf364ce5" path="/var/lib/kubelet/pods/0a688713-de7c-4a39-aba0-bbefbf364ce5/volumes"
Jul 12 15:13:45.652556 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:13:45.652515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:14:25.056648 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:14:25.056606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:14:38.150478 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:14:38.150444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:14:47.051256 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:14:47.051215    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:15:26.379882 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.379847    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:15:26.380349 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.380259    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a688713-de7c-4a39-aba0-bbefbf364ce5" containerName="maas-api"
Jul 12 15:15:26.380349 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.380274    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a688713-de7c-4a39-aba0-bbefbf364ce5" containerName="maas-api"
Jul 12 15:15:26.380458 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.380407    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a688713-de7c-4a39-aba0-bbefbf364ce5" containerName="maas-api"
Jul 12 15:15:26.383777 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.383753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.385894 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.385869    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-43c370-serving-cert\""
Jul 12 15:15:26.395652 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.395625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:15:26.535183 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.535122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.535353 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.535264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5n84\" (UniqueName: \"kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.535353 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.535304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.636592 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.636500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.636745 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.636597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5n84\" (UniqueName: \"kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.636745 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.636622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.637191 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.637165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.638983 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.638960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.645854 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.645829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5n84\" (UniqueName: \"kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84\") pod \"maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.696598 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.696564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:26.833841 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.833792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:15:26.836478 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:15:26.836451    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf8ab8a_b947_4dd0_82e2_0ddd1d218327.slice/crio-f920969be3240ee13d7b2aa6cd2a357347b7bf94ac55eb4731ea75d259892c41 WatchSource:0}: Error finding container f920969be3240ee13d7b2aa6cd2a357347b7bf94ac55eb4731ea75d259892c41: Status 404 returned error can't find the container with id f920969be3240ee13d7b2aa6cd2a357347b7bf94ac55eb4731ea75d259892c41
Jul 12 15:15:26.837819 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:26.837801    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:15:27.434918 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:27.434879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" event={"ID":"adf8ab8a-b947-4dd0-82e2-0ddd1d218327","Type":"ContainerStarted","Data":"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"}
Jul 12 15:15:27.435369 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:27.434949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" event={"ID":"adf8ab8a-b947-4dd0-82e2-0ddd1d218327","Type":"ContainerStarted","Data":"f920969be3240ee13d7b2aa6cd2a357347b7bf94ac55eb4731ea75d259892c41"}
Jul 12 15:15:27.435369 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:27.434979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:27.469942 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:27.469894    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" podStartSLOduration=0.9475386 podStartE2EDuration="1.46987734s" totalImagesPullingTime="522.33874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:15:27.467403447 +0000 UTC m=+2054.357548233" watchObservedRunningTime="2026-07-12 15:15:27.46987734 +0000 UTC m=+2054.360022125"
Jul 12 15:15:33.246649 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:33.246605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:15:33.445828 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:33.445799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:15:34.380504 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.380468    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:15:34.384727 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.384702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.386819 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.386796    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e9e47d-serving-cert\""
Jul 12 15:15:34.393993 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.393967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:15:34.511515 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.511473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.511515 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.511518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59l4d\" (UniqueName: \"kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.511762 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.511603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.612881 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.612848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.612881 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.612887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59l4d\" (UniqueName: \"kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.613095 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.612929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.613646 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.613622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.615384 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.615351    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.632804 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.632749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59l4d\" (UniqueName: \"kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d\") pod \"maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.697407 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.697366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:34.834280 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:34.834253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:15:34.835864 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:15:34.835836    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceb8bac_5f6a_463c_a927_a65cd799a5fb.slice/crio-eff9d376d900941378706d7c84c32b82540ee78249bb7a3a4ac14edc132e465c WatchSource:0}: Error finding container eff9d376d900941378706d7c84c32b82540ee78249bb7a3a4ac14edc132e465c: Status 404 returned error can't find the container with id eff9d376d900941378706d7c84c32b82540ee78249bb7a3a4ac14edc132e465c
Jul 12 15:15:35.476328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:35.476239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" event={"ID":"9ceb8bac-5f6a-463c-a927-a65cd799a5fb","Type":"ContainerStarted","Data":"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"}
Jul 12 15:15:35.476328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:35.476288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" event={"ID":"9ceb8bac-5f6a-463c-a927-a65cd799a5fb","Type":"ContainerStarted","Data":"eff9d376d900941378706d7c84c32b82540ee78249bb7a3a4ac14edc132e465c"}
Jul 12 15:15:35.476328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:35.476321    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:35.492474 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:35.492424    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" podStartSLOduration=1.169937471 podStartE2EDuration="1.492409045s" totalImagesPullingTime="322.471574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:15:35.490693349 +0000 UTC m=+2062.380838134" watchObservedRunningTime="2026-07-12 15:15:35.492409045 +0000 UTC m=+2062.382553829"
Jul 12 15:15:41.487617 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:41.487589    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:15:43.448906 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:43.448865    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:15:53.360326 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:15:53.360293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:16:04.948055 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:04.948017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:16:13.682891 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:13.682850    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:16:13.686166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:13.686140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:16:18.888720 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.888685    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:18.892304 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.892286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:18.894365 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.894346    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e9e47d\"/\"openshift-service-ca.crt\""
Jul 12 15:16:18.894365 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.894356    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e9e47d\"/\"default-dockercfg-76mkp\""
Jul 12 15:16:18.894525 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.894356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e9e47d\"/\"kube-root-ca.crt\""
Jul 12 15:16:18.894898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.894866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e9e47d\"/\"test-model-e9e47d-kserve-self-signed-certs\""
Jul 12 15:16:18.901460 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:18.901437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:19.024384 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.024384 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.024611 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.024611 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqtk\" (UniqueName: \"kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.024611 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.024611 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.024567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.125617 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.125816 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqtk\" (UniqueName: \"kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.125816 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.125816 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.125816 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.126032 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.125820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.126088 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.126058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.126088 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.126076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.126238 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.126115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.128309 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.128280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.128482 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.128462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.133702 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.133675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqtk\" (UniqueName: \"kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk\") pod \"test-model-e9e47d-kserve-66f69bd645-jkgqc\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") " pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.203032 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.202935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:19.342912 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.342886    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:19.344874 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:16:19.344847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode55a4194_d45d_4de9_8d22_31694e3b2715.slice/crio-4103899e307f310053a133b53687ad8188a8e90e7f5353b4c4a9623d37ace91b WatchSource:0}: Error finding container 4103899e307f310053a133b53687ad8188a8e90e7f5353b4c4a9623d37ace91b: Status 404 returned error can't find the container with id 4103899e307f310053a133b53687ad8188a8e90e7f5353b4c4a9623d37ace91b
Jul 12 15:16:19.695696 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.695657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" event={"ID":"e55a4194-d45d-4de9-8d22-31694e3b2715","Type":"ContainerStarted","Data":"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"}
Jul 12 15:16:19.695880 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.695707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" event={"ID":"e55a4194-d45d-4de9-8d22-31694e3b2715","Type":"ContainerStarted","Data":"4103899e307f310053a133b53687ad8188a8e90e7f5353b4c4a9623d37ace91b"}
Jul 12 15:16:19.723072 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:19.723017    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" podStartSLOduration=1.723001132 podStartE2EDuration="1.723001132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:16:19.721453187 +0000 UTC m=+2106.611597975" watchObservedRunningTime="2026-07-12 15:16:19.723001132 +0000 UTC m=+2106.613145967"
Jul 12 15:16:24.147212 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:24.147170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:16:29.203941 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:29.203906    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:29.204369 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:29.203964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:29.216498 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:29.216471    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:29.758703 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:29.758670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:37.983251 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:37.983219    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:38.825083 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:38.825046    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:16:38.825353 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:38.825327    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" podUID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" containerName="maas-api" containerID="cri-o://548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5" gracePeriod=30
Jul 12 15:16:39.087513 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.087435    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:16:39.218040 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.218004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5n84\" (UniqueName: \"kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84\") pod \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") "
Jul 12 15:16:39.218040 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.218041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls\") pod \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") "
Jul 12 15:16:39.218304 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.218084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca\") pod \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\" (UID: \"adf8ab8a-b947-4dd0-82e2-0ddd1d218327\") "
Jul 12 15:16:39.218530 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.218500    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adf8ab8a-b947-4dd0-82e2-0ddd1d218327" (UID: "adf8ab8a-b947-4dd0-82e2-0ddd1d218327"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:16:39.220219 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.220192    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adf8ab8a-b947-4dd0-82e2-0ddd1d218327" (UID: "adf8ab8a-b947-4dd0-82e2-0ddd1d218327"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:16:39.220370 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.220348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84" (OuterVolumeSpecName: "kube-api-access-f5n84") pod "adf8ab8a-b947-4dd0-82e2-0ddd1d218327" (UID: "adf8ab8a-b947-4dd0-82e2-0ddd1d218327"). InnerVolumeSpecName "kube-api-access-f5n84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:16:39.319764 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.319730    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5n84\" (UniqueName: \"kubernetes.io/projected/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-kube-api-access-f5n84\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:39.319764 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.319761    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:39.319764 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.319770    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf8ab8a-b947-4dd0-82e2-0ddd1d218327-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:39.799296 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.799261    2581 generic.go:356] "Generic (PLEG): container finished" podID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" containerID="548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5" exitCode=0
Jul 12 15:16:39.799477 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.799312    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"
Jul 12 15:16:39.799477 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.799312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" event={"ID":"adf8ab8a-b947-4dd0-82e2-0ddd1d218327","Type":"ContainerDied","Data":"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"}
Jul 12 15:16:39.799477 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.799436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd" event={"ID":"adf8ab8a-b947-4dd0-82e2-0ddd1d218327","Type":"ContainerDied","Data":"f920969be3240ee13d7b2aa6cd2a357347b7bf94ac55eb4731ea75d259892c41"}
Jul 12 15:16:39.799477 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.799469    2581 scope.go:117] "RemoveContainer" containerID="548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"
Jul 12 15:16:39.808479 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.808462    2581 scope.go:117] "RemoveContainer" containerID="548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"
Jul 12 15:16:39.808754 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:16:39.808734    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5\": container with ID starting with 548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5 not found: ID does not exist" containerID="548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"
Jul 12 15:16:39.808834 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.808761    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5"} err="failed to get container status \"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5\": rpc error: code = NotFound desc = could not find container \"548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5\": container with ID starting with 548ca4f22998ff15c64bea71ab374e356e728f9b477250eea41acd03bd0932b5 not found: ID does not exist"
Jul 12 15:16:39.813365 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.813339    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:16:39.817135 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:39.817101    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43c370-556c6f67df-fnxsd"]
Jul 12 15:16:41.611649 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:41.611615    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" path="/var/lib/kubelet/pods/adf8ab8a-b947-4dd0-82e2-0ddd1d218327/volumes"
Jul 12 15:16:42.743299 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:42.743259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:16:53.004722 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.004676    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" podUID="e55a4194-d45d-4de9-8d22-31694e3b2715" containerName="main" containerID="cri-o://9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6" gracePeriod=45
Jul 12 15:16:53.266978 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.266891    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:53.361711 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.361898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nqtk\" (UniqueName: \"kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.361898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361759    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.361898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.361898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361847    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.361898 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.361892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs\") pod \"e55a4194-d45d-4de9-8d22-31694e3b2715\" (UID: \"e55a4194-d45d-4de9-8d22-31694e3b2715\") "
Jul 12 15:16:53.362180 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362007    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:16:53.362180 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362043    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache" (OuterVolumeSpecName: "model-cache") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:16:53.362180 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362119    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home" (OuterVolumeSpecName: "home") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:16:53.362331 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362201    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-model-cache\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.362331 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362215    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-home\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.362331 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.362228    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-tmp-dir\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.363986 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.363964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm" (OuterVolumeSpecName: "dshm") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:16:53.364077 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.364056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:16:53.364115 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.364062    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk" (OuterVolumeSpecName: "kube-api-access-9nqtk") pod "e55a4194-d45d-4de9-8d22-31694e3b2715" (UID: "e55a4194-d45d-4de9-8d22-31694e3b2715"). InnerVolumeSpecName "kube-api-access-9nqtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:16:53.463484 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.463443    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55a4194-d45d-4de9-8d22-31694e3b2715-dshm\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.463484 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.463476    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55a4194-d45d-4de9-8d22-31694e3b2715-tls-certs\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.463484 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.463487    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nqtk\" (UniqueName: \"kubernetes.io/projected/e55a4194-d45d-4de9-8d22-31694e3b2715-kube-api-access-9nqtk\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:16:53.874029 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.873942    2581 generic.go:356] "Generic (PLEG): container finished" podID="e55a4194-d45d-4de9-8d22-31694e3b2715" containerID="9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6" exitCode=0
Jul 12 15:16:53.874029 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.873990    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"
Jul 12 15:16:53.874239 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.874024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" event={"ID":"e55a4194-d45d-4de9-8d22-31694e3b2715","Type":"ContainerDied","Data":"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"}
Jul 12 15:16:53.874239 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.874074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc" event={"ID":"e55a4194-d45d-4de9-8d22-31694e3b2715","Type":"ContainerDied","Data":"4103899e307f310053a133b53687ad8188a8e90e7f5353b4c4a9623d37ace91b"}
Jul 12 15:16:53.874239 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.874098    2581 scope.go:117] "RemoveContainer" containerID="9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"
Jul 12 15:16:53.883353 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.883333    2581 scope.go:117] "RemoveContainer" containerID="9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"
Jul 12 15:16:53.883616 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:16:53.883596    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6\": container with ID starting with 9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6 not found: ID does not exist" containerID="9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"
Jul 12 15:16:53.883678 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.883627    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6"} err="failed to get container status \"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6\": rpc error: code = NotFound desc = could not find container \"9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6\": container with ID starting with 9cfa070e44f41d6ae0a1311cc9ce4f78a3fb81a34d77db953c2fdbd48a359ec6 not found: ID does not exist"
Jul 12 15:16:53.889226 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.889200    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:53.892698 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:53.892673    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e9e47d/test-model-e9e47d-kserve-66f69bd645-jkgqc"]
Jul 12 15:16:55.611987 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:16:55.611950    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e55a4194-d45d-4de9-8d22-31694e3b2715" path="/var/lib/kubelet/pods/e55a4194-d45d-4de9-8d22-31694e3b2715/volumes"
Jul 12 15:17:21.722364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:21.722322    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:17:21.722834 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:21.722567    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" podUID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" containerName="maas-api" containerID="cri-o://c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2" gracePeriod=30
Jul 12 15:17:22.180833 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.180805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:17:22.228157 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.228060    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca\") pod \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") "
Jul 12 15:17:22.228347 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.228172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59l4d\" (UniqueName: \"kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d\") pod \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") "
Jul 12 15:17:22.228347 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.228257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls\") pod \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\" (UID: \"9ceb8bac-5f6a-463c-a927-a65cd799a5fb\") "
Jul 12 15:17:22.228566 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.228539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ceb8bac-5f6a-463c-a927-a65cd799a5fb" (UID: "9ceb8bac-5f6a-463c-a927-a65cd799a5fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:17:22.230446 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.230414    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d" (OuterVolumeSpecName: "kube-api-access-59l4d") pod "9ceb8bac-5f6a-463c-a927-a65cd799a5fb" (UID: "9ceb8bac-5f6a-463c-a927-a65cd799a5fb"). InnerVolumeSpecName "kube-api-access-59l4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:17:22.230630 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.230609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ceb8bac-5f6a-463c-a927-a65cd799a5fb" (UID: "9ceb8bac-5f6a-463c-a927-a65cd799a5fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:17:22.329171 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.329138    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-maas-api-tls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:17:22.329171 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.329171    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-openshift-service-ca\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:17:22.329362 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:22.329183    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59l4d\" (UniqueName: \"kubernetes.io/projected/9ceb8bac-5f6a-463c-a927-a65cd799a5fb-kube-api-access-59l4d\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:17:23.028176 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.028121    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" containerID="c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2" exitCode=0
Jul 12 15:17:23.028176 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.028181    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"
Jul 12 15:17:23.028697 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.028204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" event={"ID":"9ceb8bac-5f6a-463c-a927-a65cd799a5fb","Type":"ContainerDied","Data":"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"}
Jul 12 15:17:23.028697 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.028247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx" event={"ID":"9ceb8bac-5f6a-463c-a927-a65cd799a5fb","Type":"ContainerDied","Data":"eff9d376d900941378706d7c84c32b82540ee78249bb7a3a4ac14edc132e465c"}
Jul 12 15:17:23.028697 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.028267    2581 scope.go:117] "RemoveContainer" containerID="c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"
Jul 12 15:17:23.037992 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.037974    2581 scope.go:117] "RemoveContainer" containerID="c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"
Jul 12 15:17:23.038284 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:17:23.038264    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2\": container with ID starting with c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2 not found: ID does not exist" containerID="c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"
Jul 12 15:17:23.038371 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.038297    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2"} err="failed to get container status \"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2\": rpc error: code = NotFound desc = could not find container \"c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2\": container with ID starting with c19bff1e8664db51caf236b9deeae20ce53d4c2fd010ce6be6750d15c3ec45d2 not found: ID does not exist"
Jul 12 15:17:23.048531 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.048493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:17:23.051822 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.051798    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9e47d-c545f799b-k82fx"]
Jul 12 15:17:23.612220 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:23.612180    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" path="/var/lib/kubelet/pods/9ceb8bac-5f6a-463c-a927-a65cd799a5fb/volumes"
Jul 12 15:17:24.644674 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:24.644637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:17:28.234185 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234148    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:17:28.234554 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234545    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55a4194-d45d-4de9-8d22-31694e3b2715" containerName="main"
Jul 12 15:17:28.234594 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234556    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55a4194-d45d-4de9-8d22-31694e3b2715" containerName="main"
Jul 12 15:17:28.234594 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234573    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" containerName="maas-api"
Jul 12 15:17:28.234594 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234578    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" containerName="maas-api"
Jul 12 15:17:28.234688 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234597    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" containerName="maas-api"
Jul 12 15:17:28.234688 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234602    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" containerName="maas-api"
Jul 12 15:17:28.234776 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234692    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf8ab8a-b947-4dd0-82e2-0ddd1d218327" containerName="maas-api"
Jul 12 15:17:28.234776 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234702    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ceb8bac-5f6a-463c-a927-a65cd799a5fb" containerName="maas-api"
Jul 12 15:17:28.234776 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.234710    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e55a4194-d45d-4de9-8d22-31694e3b2715" containerName="main"
Jul 12 15:17:28.239450 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.239426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.241469 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.241446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c0c6f4-openshift-default-dockercfg-t68l5\""
Jul 12 15:17:28.252910 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.252885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:17:28.288705 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.288705 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.288966 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.288966 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxls\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.288966 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.288966 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.289158 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.288987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.289158 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.289045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.289158 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.289066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.389929 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.389885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.389929 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.389933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxls\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390198 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.389973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390198 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390198 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390606 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390606 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390606 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.390747 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.390663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.391053 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.391033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.392702 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.392675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.392875 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.392857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.397401 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.397377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.397553 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.397536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxls\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls\") pod \"e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") " pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.550318 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.550223    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:28.695900 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.695864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:17:28.696887 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:17:28.696850    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3055a9c6_3b8b_4927_8799_2c2eafd423d3.slice/crio-82d54d18645228c383e12236880fd624e850f833e01996c984e0d342a656349d WatchSource:0}: Error finding container 82d54d18645228c383e12236880fd624e850f833e01996c984e0d342a656349d: Status 404 returned error can't find the container with id 82d54d18645228c383e12236880fd624e850f833e01996c984e0d342a656349d
Jul 12 15:17:28.699438 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.699406    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:28.699516 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.699476    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:28.699516 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:28.699506    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:29.062617 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:29.062581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerStarted","Data":"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"}
Jul 12 15:17:29.062797 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:29.062632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerStarted","Data":"82d54d18645228c383e12236880fd624e850f833e01996c984e0d342a656349d"}
Jul 12 15:17:29.080794 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:29.080728    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podStartSLOduration=1.080711778 podStartE2EDuration="1.080711778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:17:29.079386514 +0000 UTC m=+2175.969531312" watchObservedRunningTime="2026-07-12 15:17:29.080711778 +0000 UTC m=+2175.970856561"
Jul 12 15:17:29.551149 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:29.551057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:29.556597 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:29.556571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:30.069987 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:30.069955    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:30.071071 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:30.071041    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:34.641515 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:34.641475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:17:42.135108 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.135025    2581 generic.go:356] "Generic (PLEG): container finished" podID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerID="a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25" exitCode=0
Jul 12 15:17:42.135108 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.135068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerDied","Data":"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"}
Jul 12 15:17:42.135573 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.135471    2581 scope.go:117] "RemoveContainer" containerID="a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"
Jul 12 15:17:42.136489 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.136462    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:42.136548 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.136530    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:42.136583 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:42.136567    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:17:43.146817 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:43.146771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerStarted","Data":"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"}
Jul 12 15:17:43.551252 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:43.551151    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:43.552443 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:43.552407    2581 patch_prober.go:28] interesting pod/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 12 15:17:43.552583 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:43.552492    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 12 15:17:44.550831 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:44.550790    2581 patch_prober.go:28] interesting pod/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 12 15:17:44.551521 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:44.551488    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 12 15:17:45.070010 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:45.069967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:45.551727 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:45.551621    2581 patch_prober.go:28] interesting pod/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 12 15:17:45.552296 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:45.552247    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 12 15:17:46.551560 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:46.551521    2581 patch_prober.go:28] interesting pod/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 12 15:17:46.551862 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:46.551829    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 12 15:17:47.555469 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:47.555432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:47.556548 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:47.556524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:17:49.049748 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:49.049703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:17:57.590002 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:57.589962    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:17:57.590602 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:17:57.590273    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" containerID="cri-o://f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2" gracePeriod=30
Jul 12 15:18:02.557959 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.557916    2581 patch_prober.go:28] interesting pod/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:18:02.558351 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.557984    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:18:02.650465 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.650429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:18:02.876364 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.876335    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:18:02.916618 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.916826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.916826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.916826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.916826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.916826 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.917093 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fxls\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.917093 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.917093 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy\") pod \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\" (UID: \"3055a9c6-3b8b-4927-8799-2c2eafd423d3\") "
Jul 12 15:18:02.917093 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.916989    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:18:02.917344 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.917275    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-certs\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:02.917613 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.917476    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:18:02.917613 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.917580    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:18:02.917843 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.917626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:18:02.917843 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.917737    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:18:02.919705 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.919667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:18:02.920311 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.920266    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:18:02.920464 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.920352    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls" (OuterVolumeSpecName: "kube-api-access-4fxls") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "kube-api-access-4fxls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:18:02.920775 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:02.920754    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3055a9c6-3b8b-4927-8799-2c2eafd423d3" (UID: "3055a9c6-3b8b-4927-8799-2c2eafd423d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:18:03.017878 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017836    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fxls\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-kube-api-access-4fxls\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.017878 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017875    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-token\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.017878 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017887    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-envoy\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.018197 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017895    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-data\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.018197 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017904    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-workload-socket\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.018197 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017912    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istio-podinfo\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.018197 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017920    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3055a9c6-3b8b-4927-8799-2c2eafd423d3-credential-socket\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.018197 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.017928    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3055a9c6-3b8b-4927-8799-2c2eafd423d3-istiod-ca-cert\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:18:03.255208 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.255104    2581 generic.go:356] "Generic (PLEG): container finished" podID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerID="f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2" exitCode=0
Jul 12 15:18:03.255208 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.255181    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"
Jul 12 15:18:03.255208 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.255188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerDied","Data":"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"}
Jul 12 15:18:03.255419 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.255267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t" event={"ID":"3055a9c6-3b8b-4927-8799-2c2eafd423d3","Type":"ContainerDied","Data":"82d54d18645228c383e12236880fd624e850f833e01996c984e0d342a656349d"}
Jul 12 15:18:03.255419 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.255290    2581 scope.go:117] "RemoveContainer" containerID="f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"
Jul 12 15:18:03.264613 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.264591    2581 scope.go:117] "RemoveContainer" containerID="a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"
Jul 12 15:18:03.273285 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.273174    2581 scope.go:117] "RemoveContainer" containerID="f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"
Jul 12 15:18:03.273981 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:18:03.273957    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2\": container with ID starting with f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2 not found: ID does not exist" containerID="f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"
Jul 12 15:18:03.274060 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.273990    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2"} err="failed to get container status \"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2\": rpc error: code = NotFound desc = could not find container \"f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2\": container with ID starting with f807792504f270f20c7f050c3b9ebf63ea0e0cc4667be9a78edaa91e2a24d8a2 not found: ID does not exist"
Jul 12 15:18:03.274060 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.274007    2581 scope.go:117] "RemoveContainer" containerID="a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"
Jul 12 15:18:03.274336 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:18:03.274308    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25\": container with ID starting with a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25 not found: ID does not exist" containerID="a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"
Jul 12 15:18:03.274433 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.274336    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25"} err="failed to get container status \"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25\": rpc error: code = NotFound desc = could not find container \"a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25\": container with ID starting with a30741282d9720a34a15b73473d70d62bf779130cea67dbb52353cb487576f25 not found: ID does not exist"
Jul 12 15:18:03.275787 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.275769    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:18:03.279449 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.279427    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c0c6f4-openshift-default-ff78b67f9-f554t"]
Jul 12 15:18:03.611823 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:03.611790    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" path="/var/lib/kubelet/pods/3055a9c6-3b8b-4927-8799-2c2eafd423d3/volumes"
Jul 12 15:18:05.168747 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.168705    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:18:05.169361 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.169341    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:18:05.169461 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.169363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:18:05.169518 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.169465    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:18:05.174077 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.174055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.176182 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.176158    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c8720c-openshift-default-dockercfg-m6fxd\""
Jul 12 15:18:05.183499 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.183472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:18:05.238630 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.238825 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.238825 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.238825 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv47r\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.238825 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.239018 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.239018 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.239018 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.239018 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.238991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339564 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339564 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv47r\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.339821 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.339864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340232 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.340159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340232 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.340187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340304 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.340259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340304 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.340282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.340584 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.340568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.342263 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.342237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.342458 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.342440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.349337 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.349316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.349434 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.349413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv47r\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r\") pod \"e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") " pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.485963 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.485876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:05.627840 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.627806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:18:05.630145 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:18:05.630092    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d9ba1d_ce6f_4d0a_834c_6b14573b33ef.slice/crio-6a985184df454d2482749dbb678815f60dbcdc92ff4e62200fe925702fd28094 WatchSource:0}: Error finding container 6a985184df454d2482749dbb678815f60dbcdc92ff4e62200fe925702fd28094: Status 404 returned error can't find the container with id 6a985184df454d2482749dbb678815f60dbcdc92ff4e62200fe925702fd28094
Jul 12 15:18:05.632421 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.632391    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:05.632496 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.632456    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:05.632496 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:05.632485    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:06.273349 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:06.273310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerStarted","Data":"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"}
Jul 12 15:18:06.273722 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:06.273373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerStarted","Data":"6a985184df454d2482749dbb678815f60dbcdc92ff4e62200fe925702fd28094"}
Jul 12 15:18:06.292200 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:06.292147    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podStartSLOduration=1.292115559 podStartE2EDuration="1.292115559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:18:06.290669423 +0000 UTC m=+2213.180814209" watchObservedRunningTime="2026-07-12 15:18:06.292115559 +0000 UTC m=+2213.182260344"
Jul 12 15:18:06.486817 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:06.486782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:06.492183 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:06.492155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:07.278935 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:07.278907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:07.280143 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:07.280103    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:14.244562 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:14.244521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:18:22.280970 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.280869    2581 patch_prober.go:28] interesting pod/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 12 15:18:22.280970 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.280931    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 12 15:18:22.366449 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.366413    2581 generic.go:356] "Generic (PLEG): container finished" podID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerID="8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9" exitCode=0
Jul 12 15:18:22.366610 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.366469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerDied","Data":"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"}
Jul 12 15:18:22.366906 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.366887    2581 scope.go:117] "RemoveContainer" containerID="8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"
Jul 12 15:18:22.367905 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.367881    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:22.367964 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.367949    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:22.368000 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:22.367982    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 12 15:18:23.374892 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:23.374847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerStarted","Data":"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"}
Jul 12 15:18:23.486497 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:23.486454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:23.486747 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:23.486723    2581 patch_prober.go:28] interesting pod/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 12 15:18:23.486802 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:23.486775    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 12 15:18:24.486799 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:24.486763    2581 patch_prober.go:28] interesting pod/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 12 15:18:24.487236 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:24.486819    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 12 15:18:25.486677 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:25.486635    2581 patch_prober.go:28] interesting pod/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 12 15:18:25.486871 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:25.486724    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 12 15:18:26.487006 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:26.486967    2581 patch_prober.go:28] interesting pod/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 12 15:18:26.487427 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:26.487026    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 12 15:18:26.657736 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:26.657698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:18:27.490936 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:27.490910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:27.491419 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:27.491240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:18:27.491864 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:18:27.491847    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:21:13.716352 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:13.716323    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:21:13.720029 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:13.720009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvdz_68de21e2-4f82-4470-b615-94d403406a30/ovn-acl-logging/0.log"
Jul 12 15:21:29.041842 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:29.041799    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:21:31.590741 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:31.590707    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:21:31.591296 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:31.590974    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy" containerID="cri-o://5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5" gracePeriod=30
Jul 12 15:21:36.855243 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:36.853785    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:21:37.002751 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002708    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.002751 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002758    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002851    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv47r\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003027 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.002992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003055    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token\") pod \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\" (UID: \"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef\") "
Jul 12 15:21:37.003377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:37.003377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003323    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:37.003377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:37.003377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003354    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:21:37.003638 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003476    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-credential-socket\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.003638 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003495    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istiod-ca-cert\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.003638 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003532    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-certs\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.003638 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.003544    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-workload-socket\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.004223 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.004194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:37.005230 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.005206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:21:37.005350 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.005336    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:37.005600 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.005575    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:37.005600 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.005584    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r" (OuterVolumeSpecName: "kube-api-access-lv47r") pod "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" (UID: "05d9ba1d-ce6f-4d0a-834c-6b14573b33ef"). InnerVolumeSpecName "kube-api-access-lv47r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:37.104659 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.104623    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-token\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.104659 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.104654    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-envoy\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.104659 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.104665    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-podinfo\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.104904 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.104675    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-istio-data\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.104904 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.104684    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv47r\" (UniqueName: \"kubernetes.io/projected/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef-kube-api-access-lv47r\") on node \"ip-10-0-139-143.ec2.internal\" DevicePath \"\""
Jul 12 15:21:37.402140 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.402092    2581 generic.go:356] "Generic (PLEG): container finished" podID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerID="5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5" exitCode=0
Jul 12 15:21:37.402315 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.402153    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"
Jul 12 15:21:37.402315 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.402155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerDied","Data":"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"}
Jul 12 15:21:37.402315 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.402309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97" event={"ID":"05d9ba1d-ce6f-4d0a-834c-6b14573b33ef","Type":"ContainerDied","Data":"6a985184df454d2482749dbb678815f60dbcdc92ff4e62200fe925702fd28094"}
Jul 12 15:21:37.402437 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.402343    2581 scope.go:117] "RemoveContainer" containerID="5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"
Jul 12 15:21:37.412444 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.412425    2581 scope.go:117] "RemoveContainer" containerID="8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"
Jul 12 15:21:37.420699 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.420670    2581 scope.go:117] "RemoveContainer" containerID="5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"
Jul 12 15:21:37.421049 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:21:37.421014    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5\": container with ID starting with 5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5 not found: ID does not exist" containerID="5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"
Jul 12 15:21:37.421195 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.421053    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5"} err="failed to get container status \"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5\": rpc error: code = NotFound desc = could not find container \"5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5\": container with ID starting with 5f4d4ee3affb3621dbd9a2bc2b7f664a479897c2684152e90e0601e94cc4c6f5 not found: ID does not exist"
Jul 12 15:21:37.421195 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.421079    2581 scope.go:117] "RemoveContainer" containerID="8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"
Jul 12 15:21:37.421374 ip-10-0-139-143 kubenswrapper[2581]: E0712 15:21:37.421353    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9\": container with ID starting with 8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9 not found: ID does not exist" containerID="8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"
Jul 12 15:21:37.421429 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.421379    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9"} err="failed to get container status \"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9\": rpc error: code = NotFound desc = could not find container \"8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9\": container with ID starting with 8ed093368853e6f7afd81129061a9989d6df803869ffaeacc970cc5f0781e3c9 not found: ID does not exist"
Jul 12 15:21:37.423118 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.423096    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:21:37.426775 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.426751    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c8720c-openshift-default-5fd4df65f-2rc97"]
Jul 12 15:21:37.613195 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:37.613162    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" path="/var/lib/kubelet/pods/05d9ba1d-ce6f-4d0a-834c-6b14573b33ef/volumes"
Jul 12 15:21:40.145386 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:40.145350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n8thk"]
Jul 12 15:21:43.443636 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:43.443605    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qljsc_c8ec2881-95db-4b6a-bc51-cbdd60de7d9e/manager/0.log"
Jul 12 15:21:43.563981 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:43.563929    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-np8wj_4e40dd27-b8fe-4fd5-8435-bcf199b92bc9/manager/0.log"
Jul 12 15:21:43.685000 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:43.684970    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fd9449f55-f76fz_8e20e708-7a66-4f30-b0cd-34caae45c5a1/manager/0.log"
Jul 12 15:21:43.916592 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:43.916563    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ksk9w_f1f49965-42f2-44da-8363-2bad3b549939/manager/0.log"
Jul 12 15:21:44.283982 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:44.283895    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9f5575-rcpjs_46b73fb3-0757-4aa7-81ff-155cfa053a02/copy-manifests/0.log"
Jul 12 15:21:44.291704 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:44.291675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9f5575-rcpjs_46b73fb3-0757-4aa7-81ff-155cfa053a02/manager/0.log"
Jul 12 15:21:45.639442 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:45.639412    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kr2zp_1aa4fce0-3582-4d7e-a1b0-5b835e296745/manager/0.log"
Jul 12 15:21:45.748634 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:45.748604    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8cjd5_bee2c649-ffa1-490d-a675-b1f1fb2552be/manager/0.log"
Jul 12 15:21:45.859465 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:45.859434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n5nkl_77f2eaac-7d18-4492-9eb3-3af47bedf6d9/kuadrant-console-plugin/0.log"
Jul 12 15:21:45.982160 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:45.982062    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lkvtd_dc184baf-c25b-4619-a333-4189cef31cfd/registry-server/0.log"
Jul 12 15:21:46.204180 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:46.204150    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n8thk_34def8ad-c591-4c79-bd13-3db72cc48bc6/limitador/0.log"
Jul 12 15:21:46.322569 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:46.322536    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlddj_d08d7a6e-1cb7-4767-bf60-250972f63415/manager/0.log"
Jul 12 15:21:46.987037 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:46.987010    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b855bfc69-vqmj8_ed005c91-511e-4fcb-b957-be442cbbb14a/kube-auth-proxy/0.log"
Jul 12 15:21:47.110956 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:47.110897    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/1.log"
Jul 12 15:21:47.231937 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:47.231889    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85rmf_61143cf5-51ef-421f-90b3-820a2a9db90d/payload-pre-processing/0.log"
Jul 12 15:21:47.346483 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:47.346443    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-htz2v_f991202c-4b37-42fe-9744-875397ea7136/payload-processing/0.log"
Jul 12 15:21:47.779762 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:47.779641    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r4bps_f0ba44e6-2258-40e8-9ce7-7be91987a0fa/main/0.log"
Jul 12 15:21:48.206698 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:48.206667    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9vwvl_e67d0db7-419f-4ea3-9d23-bdf3c32a771e/main/0.log"
Jul 12 15:21:48.319007 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:48.318970    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vktsz_16fa2eab-76a8-4502-bfe7-581eb3997ffa/main/0.log"
Jul 12 15:21:55.421824 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:55.421791    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qhb57_43fa45f1-36ac-4043-beda-74d189b4d35b/global-pull-secret-syncer/0.log"
Jul 12 15:21:55.615881 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:55.615840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bmzdc_71a36f31-abd5-4a71-8d9e-df2e5ea8f4e6/konnectivity-agent/0.log"
Jul 12 15:21:55.662691 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:21:55.662660    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-143.ec2.internal_8fdfd063a846aba40894375a4d9f448c/haproxy/0.log"
Jul 12 15:22:00.667828 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:00.667783    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kr2zp_1aa4fce0-3582-4d7e-a1b0-5b835e296745/manager/0.log"
Jul 12 15:22:00.703757 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:00.703726    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8cjd5_bee2c649-ffa1-490d-a675-b1f1fb2552be/manager/0.log"
Jul 12 15:22:00.731876 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:00.731848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n5nkl_77f2eaac-7d18-4492-9eb3-3af47bedf6d9/kuadrant-console-plugin/0.log"
Jul 12 15:22:00.780025 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:00.779993    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lkvtd_dc184baf-c25b-4619-a333-4189cef31cfd/registry-server/0.log"
Jul 12 15:22:00.913380 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:00.913350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n8thk_34def8ad-c591-4c79-bd13-3db72cc48bc6/limitador/0.log"
Jul 12 15:22:01.012393 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:01.012281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlddj_d08d7a6e-1cb7-4767-bf60-250972f63415/manager/0.log"
Jul 12 15:22:02.735020 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.734977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/alertmanager/0.log"
Jul 12 15:22:02.754900 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.754796    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/config-reloader/0.log"
Jul 12 15:22:02.774396 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.774369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/kube-rbac-proxy-web/0.log"
Jul 12 15:22:02.794105 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.794075    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/kube-rbac-proxy/0.log"
Jul 12 15:22:02.812685 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.812658    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/kube-rbac-proxy-metric/0.log"
Jul 12 15:22:02.840447 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.840416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/prom-label-proxy/0.log"
Jul 12 15:22:02.871657 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:02.871628    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a1640320-e72c-444c-afb2-ca29c61048b7/init-config-reloader/0.log"
Jul 12 15:22:03.017179 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.017070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mr75f_dbea8432-c428-48f6-ad6c-c1015d22439b/kube-state-metrics/0.log"
Jul 12 15:22:03.031630 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.031602    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mr75f_dbea8432-c428-48f6-ad6c-c1015d22439b/kube-rbac-proxy-main/0.log"
Jul 12 15:22:03.050165 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.050118    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mr75f_dbea8432-c428-48f6-ad6c-c1015d22439b/kube-rbac-proxy-self/0.log"
Jul 12 15:22:03.077066 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.077038    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67bd849d4f-vznfd_356e7cb6-0762-4aaf-b320-16701213854b/metrics-server/0.log"
Jul 12 15:22:03.218140 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.218105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnn6m_a2e954e4-e706-4ad2-9058-4584b28922f8/node-exporter/0.log"
Jul 12 15:22:03.236717 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.236692    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnn6m_a2e954e4-e706-4ad2-9058-4584b28922f8/kube-rbac-proxy/0.log"
Jul 12 15:22:03.256299 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.256273    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnn6m_a2e954e4-e706-4ad2-9058-4584b28922f8/init-textfile/0.log"
Jul 12 15:22:03.356386 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.356357    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f2467_5c88434e-2128-4c6d-999c-48563ec53e41/kube-rbac-proxy-main/0.log"
Jul 12 15:22:03.378922 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.378893    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f2467_5c88434e-2128-4c6d-999c-48563ec53e41/kube-rbac-proxy-self/0.log"
Jul 12 15:22:03.393970 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:03.393940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f2467_5c88434e-2128-4c6d-999c-48563ec53e41/openshift-state-metrics/0.log"
Jul 12 15:22:05.094635 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.094604    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"]
Jul 12 15:22:05.095247 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095228    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy"
Jul 12 15:22:05.095348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095249    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy"
Jul 12 15:22:05.095348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095304    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:22:05.095348 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095314    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:22:05.095514 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095405    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3055a9c6-3b8b-4927-8799-2c2eafd423d3" containerName="istio-proxy"
Jul 12 15:22:05.095514 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095419    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy"
Jul 12 15:22:05.095514 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.095430    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d9ba1d-ce6f-4d0a-834c-6b14573b33ef" containerName="istio-proxy"
Jul 12 15:22:05.098697 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.098674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.100613 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.100594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqvj9\"/\"openshift-service-ca.crt\""
Jul 12 15:22:05.101195 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.101175    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pqvj9\"/\"default-dockercfg-r5xdj\""
Jul 12 15:22:05.101299 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.101228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqvj9\"/\"kube-root-ca.crt\""
Jul 12 15:22:05.104869 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.104838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"]
Jul 12 15:22:05.166003 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.165961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-podres\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.166003 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.166000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-sys\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.166328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.166024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-lib-modules\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.166328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.166204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlldf\" (UniqueName: \"kubernetes.io/projected/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-kube-api-access-rlldf\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.166328 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.166266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-proc\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.266863 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.266820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-proc\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267067 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.266881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-podres\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267067 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.266913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-sys\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267067 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.266936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-lib-modules\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267067 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.266961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-proc\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267067 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.267052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-sys\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267372 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.267083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-podres\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267372 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.267083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-lib-modules\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.267372 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.267060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlldf\" (UniqueName: \"kubernetes.io/projected/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-kube-api-access-rlldf\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.274305 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.274277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlldf\" (UniqueName: \"kubernetes.io/projected/0b3f3ecd-3383-4719-a8dc-75e47c814b8e-kube-api-access-rlldf\") pod \"perf-node-gather-daemonset-j5zp9\" (UID: \"0b3f3ecd-3383-4719-a8dc-75e47c814b8e\") " pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.409836 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.409732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:05.546647 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:05.546623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"]
Jul 12 15:22:05.548958 ip-10-0-139-143 kubenswrapper[2581]: W0712 15:22:05.548924    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b3f3ecd_3383_4719_a8dc_75e47c814b8e.slice/crio-602ffa2d2a548c69bc743dcc4bac535d2f5da2bac1a84d54714e6cc2455cd966 WatchSource:0}: Error finding container 602ffa2d2a548c69bc743dcc4bac535d2f5da2bac1a84d54714e6cc2455cd966: Status 404 returned error can't find the container with id 602ffa2d2a548c69bc743dcc4bac535d2f5da2bac1a84d54714e6cc2455cd966
Jul 12 15:22:06.098056 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:06.098005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-xhgc5_a924f313-e49a-4868-bd09-2b3c84b64b52/download-server/0.log"
Jul 12 15:22:06.555394 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:06.555303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9" event={"ID":"0b3f3ecd-3383-4719-a8dc-75e47c814b8e","Type":"ContainerStarted","Data":"7edd7b599549b0128717e4285f534f05025dddd9b636af15294c842863bdbb8a"}
Jul 12 15:22:06.555394 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:06.555353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9" event={"ID":"0b3f3ecd-3383-4719-a8dc-75e47c814b8e","Type":"ContainerStarted","Data":"602ffa2d2a548c69bc743dcc4bac535d2f5da2bac1a84d54714e6cc2455cd966"}
Jul 12 15:22:06.555592 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:06.555395    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:06.570594 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:06.570486    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9" podStartSLOduration=1.570467061 podStartE2EDuration="1.570467061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:06.570286288 +0000 UTC m=+2453.460431063" watchObservedRunningTime="2026-07-12 15:22:06.570467061 +0000 UTC m=+2453.460611853"
Jul 12 15:22:07.775494 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:07.775440    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qw5w_ccdf7363-d0da-432d-95f2-68e8aa96527f/dns/0.log"
Jul 12 15:22:07.795202 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:07.795167    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qw5w_ccdf7363-d0da-432d-95f2-68e8aa96527f/kube-rbac-proxy/0.log"
Jul 12 15:22:07.861268 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:07.861242    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ddz4m_51e72614-2f15-488e-809c-9c6cf457b196/dns-node-resolver/0.log"
Jul 12 15:22:08.429393 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:08.429343    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-795ccc884-plldw_6d7e489a-8b16-4abf-929d-cc4c83dd4db0/registry/0.log"
Jul 12 15:22:08.450327 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:08.450293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6f4b6_ee634728-10e6-46d5-987c-9a9f28873e67/node-ca/0.log"
Jul 12 15:22:09.511436 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:09.511401    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b855bfc69-vqmj8_ed005c91-511e-4fcb-b957-be442cbbb14a/kube-auth-proxy/0.log"
Jul 12 15:22:09.540444 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:09.540408    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/0.log"
Jul 12 15:22:09.595446 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:09.595402    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/1.log"
Jul 12 15:22:09.645797 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:09.645759    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85rmf_61143cf5-51ef-421f-90b3-820a2a9db90d/payload-pre-processing/0.log"
Jul 12 15:22:09.714797 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:09.714765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-htz2v_f991202c-4b37-42fe-9744-875397ea7136/payload-processing/0.log"
Jul 12 15:22:10.392782 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:10.392753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pr645_e9498cfe-27dd-4a0d-a175-d974f81adfce/serve-healthcheck-canary/0.log"
Jul 12 15:22:10.948820 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:10.948783    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxr9p_09e9bd4f-4118-41a1-9106-944dcc312136/kube-rbac-proxy/0.log"
Jul 12 15:22:10.968029 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:10.968001    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxr9p_09e9bd4f-4118-41a1-9106-944dcc312136/exporter/0.log"
Jul 12 15:22:10.987952 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:10.987925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxr9p_09e9bd4f-4118-41a1-9106-944dcc312136/extractor/0.log"
Jul 12 15:22:12.570377 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:12.570348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pqvj9/perf-node-gather-daemonset-j5zp9"
Jul 12 15:22:13.107879 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.107841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qljsc_c8ec2881-95db-4b6a-bc51-cbdd60de7d9e/manager/0.log"
Jul 12 15:22:13.287141 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.287108    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-np8wj_4e40dd27-b8fe-4fd5-8435-bcf199b92bc9/manager/0.log"
Jul 12 15:22:13.415923 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.415833    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fd9449f55-f76fz_8e20e708-7a66-4f30-b0cd-34caae45c5a1/manager/0.log"
Jul 12 15:22:13.532587 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.532530    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ksk9w_f1f49965-42f2-44da-8363-2bad3b549939/manager/0.log"
Jul 12 15:22:13.706162 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.706053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9f5575-rcpjs_46b73fb3-0757-4aa7-81ff-155cfa053a02/manager/0.log"
Jul 12 15:22:13.723493 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:13.723467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9f5575-rcpjs_46b73fb3-0757-4aa7-81ff-155cfa053a02/copy-manifests/0.log"
Jul 12 15:22:15.228294 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:15.228251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b855bfc69-vqmj8_ed005c91-511e-4fcb-b957-be442cbbb14a/kube-auth-proxy/0.log"
Jul 12 15:22:15.249035 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:15.248997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/0.log"
Jul 12 15:22:15.301771 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:15.301737    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/1.log"
Jul 12 15:22:15.343683 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:15.343649    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85rmf_61143cf5-51ef-421f-90b3-820a2a9db90d/payload-pre-processing/0.log"
Jul 12 15:22:15.400143 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:15.399996    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-htz2v_f991202c-4b37-42fe-9744-875397ea7136/payload-processing/0.log"
Jul 12 15:22:16.679233 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:16.679143    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b855bfc69-vqmj8_ed005c91-511e-4fcb-b957-be442cbbb14a/kube-auth-proxy/0.log"
Jul 12 15:22:16.699281 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:16.699250    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/0.log"
Jul 12 15:22:16.756803 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:16.756765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwcdd_cdd94a84-e5f7-4ebd-8882-8750beeca880/istio-proxy/1.log"
Jul 12 15:22:16.798403 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:16.798363    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85rmf_61143cf5-51ef-421f-90b3-820a2a9db90d/payload-pre-processing/0.log"
Jul 12 15:22:16.868274 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:16.868230    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-htz2v_f991202c-4b37-42fe-9744-875397ea7136/payload-processing/0.log"
Jul 12 15:22:21.325382 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.325347    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/kube-multus-additional-cni-plugins/0.log"
Jul 12 15:22:21.343822 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.343792    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/egress-router-binary-copy/0.log"
Jul 12 15:22:21.362637 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.362611    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/cni-plugins/0.log"
Jul 12 15:22:21.382074 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.382046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/bond-cni-plugin/0.log"
Jul 12 15:22:21.399775 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.399749    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/routeoverride-cni/0.log"
Jul 12 15:22:21.417315 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.417292    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/whereabouts-cni-bincopy/0.log"
Jul 12 15:22:21.435278 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.435249    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4bg9_2d9f0db8-c95d-49de-bd7d-49d2207b6170/whereabouts-cni/0.log"
Jul 12 15:22:21.629817 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.629742    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fbz8c_4a0f31f8-3a4d-4d1f-86ee-d315ce1edc14/kube-multus/0.log"
Jul 12 15:22:21.790714 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.790687    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q4pl4_45d028c1-3064-40db-9cdc-a0063eae53d4/network-metrics-daemon/0.log"
Jul 12 15:22:21.806166 ip-10-0-139-143 kubenswrapper[2581]: I0712 15:22:21.806113    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q4pl4_45d028c1-3064-40db-9cdc-a0063eae53d4/kube-rbac-proxy/0.log"